Note: This is test shard 3 of 3.
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/2
2026-06-18T19:56:41Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-06-18T19:56:41Z Disabled control of system clock
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-task_3iVrE/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-task_3iVrE/thirdparty/src/hadoop-3.4.1/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL: jdbc:derby:/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/metadb;create=true
Metastore Connection Driver : org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User: APP
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.derby.sql
Initialization script completed
schemaTool completed
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/security.properties
2026-06-18 19:56:49: Starting Hive Metastore Server
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-task_3iVrE/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-task_3iVrE/thirdparty/src/hadoop-3.4.1/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Starting hive metastore on port 0
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260618 19:56:58.558148 2682 external_mini_cluster.cc:1372] Running /tmp/dist-test-task_3iVrE/build/asan/bin/kudu
/tmp/dist-test-task_3iVrE/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.158.190:41233
--webserver_interface=127.2.158.190
--webserver_port=0
--builtin_ntp_servers=127.2.158.148:40109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975
--hive_metastore_uris=thrift://127.0.0.1:43379
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260618 19:56:58.925050 2966 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 19:56:58.925493 2966 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 19:56:58.925616 2966 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260618 19:56:58.934427 2966 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 19:56:58.934530 2966 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260618 19:56:58.934623 2966 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 19:56:58.934682 2966 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260618 19:56:58.945626 2966 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.158.148:40109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:43379
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.158.190:41233
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.158.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 18 Jun 2026 19:43:24 UTC on bdcb31816ec0
build id 12458
ASAN enabled
I20260618 19:56:58.947345 2966 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 19:56:58.949241 2966 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260618 19:56:58.958209 2974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 19:56:58.958361 2971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 19:56:58.958196 2972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 19:56:58.959139 2966 server_base.cc:1061] running on GCE node
I20260618 19:56:58.960067 2966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 19:56:58.961719 2966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 19:56:58.963001 2966 hybrid_clock.cc:648] HybridClock initialized: now 1781812618962945 us; error 66 us; skew 500 ppm
I20260618 19:56:58.963393 2966 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260618 19:56:58.966046 2966 webserver.cc:533] Webserver started at http://127.2.158.190:46621/ using document root <none> and password file <none>
I20260618 19:56:58.966851 2966 fs_manager.cc:362] Metadata directory not provided
I20260618 19:56:58.966946 2966 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 19:56:58.967320 2966 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 19:56:58.969978 2966 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/data/instance:
uuid: "acc600e5aa44409ea3ce4c2861cb4de1"
format_stamp: "Formatted at 2026-06-18 19:56:58 on dist-test-slave-6zlr"
I20260618 19:56:58.970818 2966 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/wal/instance:
uuid: "acc600e5aa44409ea3ce4c2861cb4de1"
format_stamp: "Formatted at 2026-06-18 19:56:58 on dist-test-slave-6zlr"
I20260618 19:56:58.976869 2966 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260618 19:56:58.980890 2980 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 19:56:58.982350 2966 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260618 19:56:58.982550 2966 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/data,/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/wal
uuid: "acc600e5aa44409ea3ce4c2861cb4de1"
format_stamp: "Formatted at 2026-06-18 19:56:58 on dist-test-slave-6zlr"
I20260618 19:56:58.982760 2966 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 19:56:59.011395 2966 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 19:56:59.012355 2966 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 19:56:59.012656 2966 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 19:56:59.038448 2966 rpc_server.cc:307] RPC server started. Bound to: 127.2.158.190:41233
I20260618 19:56:59.038467 3031 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.158.190:41233 every 8 connection(s)
I20260618 19:56:59.040567 2966 server_base.cc:1193] Dumped server information to /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/data/info.pb
I20260618 19:56:59.045181 3032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:56:59.048584 2682 external_mini_cluster.cc:1434] Started /tmp/dist-test-task_3iVrE/build/asan/bin/kudu as pid 2966
I20260618 19:56:59.048924 2682 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/wal/instance
I20260618 19:56:59.051630 2682 external_mini_cluster.cc:1372] Running /tmp/dist-test-task_3iVrE/build/asan/bin/kudu
/tmp/dist-test-task_3iVrE/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.158.189:45955
--webserver_interface=127.2.158.189
--webserver_port=0
--builtin_ntp_servers=127.2.158.148:40109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975
--hive_metastore_uris=thrift://127.0.0.1:43379
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260618 19:56:59.051249 3032 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } has no permanent_uuid. Determining permanent_uuid...
I20260618 19:56:59.069732 3032 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } has no permanent_uuid. Determining permanent_uuid...
W20260618 19:56:59.071254 2983 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
W20260618 19:56:59.074271 3032 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.158.189:45955: Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 19:56:59.123733 3032 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } attempt: 1
W20260618 19:56:59.126286 3032 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.158.189:45955: Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 19:56:59.194607 3032 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } attempt: 2
W20260618 19:56:59.197774 3032 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.158.189:45955: Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 19:56:59.289136 3032 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } attempt: 3
W20260618 19:56:59.291819 3032 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.158.189:45955: Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 19:56:59.435124 3032 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } attempt: 4
W20260618 19:56:59.437160 3032 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.158.189:45955: Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
W20260618 19:56:59.442807 3034 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 19:56:59.443172 3034 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 19:56:59.443312 3034 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260618 19:56:59.452966 3034 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 19:56:59.453078 3034 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260618 19:56:59.453163 3034 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 19:56:59.453238 3034 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260618 19:56:59.466501 3034 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.158.148:40109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:43379
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.158.189:45955
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.2.158.189
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 18 Jun 2026 19:43:24 UTC on bdcb31816ec0
build id 12458
ASAN enabled
I20260618 19:56:59.468669 3034 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 19:56:59.470861 3034 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260618 19:56:59.480705 3041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 19:56:59.480834 3042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 19:56:59.481468 3044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 19:56:59.487581 3034 server_base.cc:1061] running on GCE node
I20260618 19:56:59.488551 3034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 19:56:59.490240 3034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 19:56:59.491462 3034 hybrid_clock.cc:648] HybridClock initialized: now 1781812619491385 us; error 68 us; skew 500 ppm
I20260618 19:56:59.491858 3034 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260618 19:56:59.494364 3034 webserver.cc:533] Webserver started at http://127.2.158.189:36353/ using document root <none> and password file <none>
I20260618 19:56:59.495179 3034 fs_manager.cc:362] Metadata directory not provided
I20260618 19:56:59.495272 3034 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 19:56:59.495710 3034 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 19:56:59.498248 3034 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/data/instance:
uuid: "0447960184714aaf886ca15b9aa0e63a"
format_stamp: "Formatted at 2026-06-18 19:56:59 on dist-test-slave-6zlr"
I20260618 19:56:59.499070 3034 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/wal/instance:
uuid: "0447960184714aaf886ca15b9aa0e63a"
format_stamp: "Formatted at 2026-06-18 19:56:59 on dist-test-slave-6zlr"
I20260618 19:56:59.504954 3034 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260618 19:56:59.508770 3050 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 19:56:59.510466 3034 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260618 19:56:59.510685 3034 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/data,/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/wal
uuid: "0447960184714aaf886ca15b9aa0e63a"
format_stamp: "Formatted at 2026-06-18 19:56:59 on dist-test-slave-6zlr"
I20260618 19:56:59.510931 3034 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 19:56:59.527757 3034 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 19:56:59.528703 3034 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 19:56:59.528968 3034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 19:56:59.553056 3034 rpc_server.cc:307] RPC server started. Bound to: 127.2.158.189:45955
I20260618 19:56:59.553056 3101 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.158.189:45955 every 8 connection(s)
I20260618 19:56:59.554976 3034 server_base.cc:1193] Dumped server information to /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/data/info.pb
I20260618 19:56:59.559837 3102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:56:59.565487 2682 external_mini_cluster.cc:1434] Started /tmp/dist-test-task_3iVrE/build/asan/bin/kudu as pid 3034
I20260618 19:56:59.565734 2682 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/wal/instance
I20260618 19:56:59.567063 2682 external_mini_cluster.cc:1372] Running /tmp/dist-test-task_3iVrE/build/asan/bin/kudu
/tmp/dist-test-task_3iVrE/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.158.188:34975
--webserver_interface=127.2.158.188
--webserver_port=0
--builtin_ntp_servers=127.2.158.148:40109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975
--hive_metastore_uris=thrift://127.0.0.1:43379
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260618 19:56:59.566602 3102 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } has no permanent_uuid. Determining permanent_uuid...
I20260618 19:56:59.583101 3102 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } has no permanent_uuid. Determining permanent_uuid...
I20260618 19:56:59.594779 3102 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } has no permanent_uuid. Determining permanent_uuid...
W20260618 19:56:59.596148 3053 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111)
W20260618 19:56:59.598555 3102 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.158.188:34975: Network error: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111)
I20260618 19:56:59.648298 3102 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } attempt: 1
W20260618 19:56:59.651439 3102 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.158.188:34975: Network error: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111)
I20260618 19:56:59.719765 3102 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } attempt: 2
W20260618 19:56:59.722186 3102 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.158.188:34975: Network error: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111)
I20260618 19:56:59.736548 3032 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } attempt: 5
I20260618 19:56:59.743769 3032 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } has no permanent_uuid. Determining permanent_uuid...
W20260618 19:56:59.745896 3032 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.158.188:34975: Network error: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111)
I20260618 19:56:59.797175 3032 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } attempt: 1
W20260618 19:56:59.799314 3032 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.158.188:34975: Network error: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111)
I20260618 19:56:59.813472 3102 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } attempt: 3
W20260618 19:56:59.815850 3102 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.158.188:34975: Network error: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111)
I20260618 19:56:59.867550 3032 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } attempt: 2
W20260618 19:56:59.869657 3032 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.158.188:34975: Network error: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111)
W20260618 19:56:59.951673 3105 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 19:56:59.952172 3105 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 19:56:59.952344 3105 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260618 19:56:59.959267 3102 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } attempt: 4
W20260618 19:56:59.961884 3102 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.158.188:34975: Network error: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111)
W20260618 19:56:59.964414 3105 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 19:56:59.964612 3105 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260618 19:56:59.964738 3105 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 19:56:59.964834 3105 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260618 19:56:59.975912 3032 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } attempt: 3
W20260618 19:56:59.979754 3032 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.158.188:34975: Network error: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111)
I20260618 19:56:59.979727 3105 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.158.148:40109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:43379
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.158.188:34975
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.2.158.188
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 18 Jun 2026 19:43:24 UTC on bdcb31816ec0
build id 12458
ASAN enabled
I20260618 19:56:59.981644 3105 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 19:56:59.983826 3105 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260618 19:56:59.992853 3113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 19:56:59.992836 3112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 19:56:59.993603 3115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 19:56:59.993954 3105 server_base.cc:1061] running on GCE node
I20260618 19:56:59.994694 3105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 19:56:59.996133 3105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 19:56:59.997393 3105 hybrid_clock.cc:648] HybridClock initialized: now 1781812619997339 us; error 44 us; skew 500 ppm
I20260618 19:56:59.997771 3105 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260618 19:57:00.000392 3105 webserver.cc:533] Webserver started at http://127.2.158.188:36245/ using document root <none> and password file <none>
I20260618 19:57:00.001163 3105 fs_manager.cc:362] Metadata directory not provided
I20260618 19:57:00.001313 3105 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 19:57:00.001673 3105 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 19:57:00.004165 3105 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data/instance:
uuid: "6c13c838eb85465090e1bff0df28912f"
format_stamp: "Formatted at 2026-06-18 19:57:00 on dist-test-slave-6zlr"
I20260618 19:57:00.004918 3105 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/wal/instance:
uuid: "6c13c838eb85465090e1bff0df28912f"
format_stamp: "Formatted at 2026-06-18 19:57:00 on dist-test-slave-6zlr"
I20260618 19:57:00.011138 3105 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260618 19:57:00.015632 3121 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 19:57:00.017575 3105 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260618 19:57:00.017776 3105 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data,/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/wal
uuid: "6c13c838eb85465090e1bff0df28912f"
format_stamp: "Formatted at 2026-06-18 19:57:00 on dist-test-slave-6zlr"
I20260618 19:57:00.017992 3105 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 19:57:00.033668 3105 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 19:57:00.034910 3105 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 19:57:00.035281 3105 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 19:57:00.063146 3105 rpc_server.cc:307] RPC server started. Bound to: 127.2.158.188:34975
I20260618 19:57:00.063194 3172 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.158.188:34975 every 8 connection(s)
I20260618 19:57:00.064893 3105 server_base.cc:1193] Dumped server information to /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data/info.pb
I20260618 19:57:00.071240 3173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:00.071223 2682 external_mini_cluster.cc:1434] Started /tmp/dist-test-task_3iVrE/build/asan/bin/kudu as pid 3105
I20260618 19:57:00.071470 2682 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/wal/instance
I20260618 19:57:00.081863 3173 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } has no permanent_uuid. Determining permanent_uuid...
I20260618 19:57:00.098479 3173 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } has no permanent_uuid. Determining permanent_uuid...
I20260618 19:57:00.108757 3173 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } has no permanent_uuid. Determining permanent_uuid...
I20260618 19:57:00.125757 3173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: Bootstrap starting.
I20260618 19:57:00.129138 3173 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:00.130631 3173 log.cc:826] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: Log is configured to *not* fsync() on all Append() calls
I20260618 19:57:00.134518 3173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: No bootstrap required, opened a new log
I20260618 19:57:00.140057 3173 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:00.140383 3173 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:00.140525 3173 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c13c838eb85465090e1bff0df28912f, State: Initialized, Role: FOLLOWER
I20260618 19:57:00.141219 3173 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:00.142884 3181 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:00.143167 3181 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: This master's current role is: FOLLOWER
I20260618 19:57:00.144100 3173 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: configured and running, proceeding with master startup.
I20260618 19:57:00.156980 3032 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } attempt: 4
I20260618 19:57:00.152844 3105 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: OK, instance_id { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" instance_seqno: 1781812619031046 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260618 19:57:00.169587 3105 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 19:57:00.172580 3195 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260618 19:57:00.172842 3195 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260618 19:57:00.173525 3032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1: Bootstrap starting.
I20260618 19:57:00.178048 3032 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:00.181344 3032 log.cc:826] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1: Log is configured to *not* fsync() on all Append() calls
I20260618 19:57:00.184990 3032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1: No bootstrap required, opened a new log
I20260618 19:57:00.192848 3032 raft_consensus.cc:359] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:00.193251 3032 raft_consensus.cc:385] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:00.193415 3032 raft_consensus.cc:740] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acc600e5aa44409ea3ce4c2861cb4de1, State: Initialized, Role: FOLLOWER
I20260618 19:57:00.194336 3032 consensus_queue.cc:260] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:00.214426 3199 sys_catalog.cc:455] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:00.220283 3032 sys_catalog.cc:565] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 19:57:00.220506 3199 sys_catalog.cc:458] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [sys.catalog]: This master's current role is: FOLLOWER
I20260618 19:57:00.261101 3102 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } attempt: 5
I20260618 19:57:00.261096 3214 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260618 19:57:00.264482 3199 raft_consensus.cc:493] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:00.264757 3199 raft_consensus.cc:515] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
W20260618 19:57:00.265803 2986 tablet.cc:2406] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260618 19:57:00.266587 3199 leader_election.cc:290] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955), 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975)
I20260618 19:57:00.270406 3148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c13c838eb85465090e1bff0df28912f" is_pre_election: true
I20260618 19:57:00.271070 3148 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acc600e5aa44409ea3ce4c2861cb4de1 in term 0.
I20260618 19:57:00.271647 2983 leader_election.cc:304] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f, acc600e5aa44409ea3ce4c2861cb4de1; no voters:
I20260618 19:57:00.272059 3199 raft_consensus.cc:2804] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 19:57:00.272279 3199 raft_consensus.cc:493] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 19:57:00.272377 3199 raft_consensus.cc:3060] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:00.266316 2966 master_runner.cc:187] Error getting master registration for 127.2.158.189:45955: OK, instance_id { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" instance_seqno: 1781812619546343 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260618 19:57:00.274268 2966 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260618 19:57:00.276304 3102 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: Bootstrap starting.
I20260618 19:57:00.280699 3102 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:00.282177 3102 log.cc:826] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: Log is configured to *not* fsync() on all Append() calls
I20260618 19:57:00.285789 3102 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: No bootstrap required, opened a new log
W20260618 19:57:00.287809 3127 tablet.cc:2406] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260618 19:57:00.293891 3102 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:00.294260 3102 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:00.294389 3102 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0447960184714aaf886ca15b9aa0e63a, State: Initialized, Role: FOLLOWER
I20260618 19:57:00.295156 3102 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:00.296806 3216 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:00.297439 3216 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: This master's current role is: FOLLOWER
I20260618 19:57:00.297986 3102 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: configured and running, proceeding with master startup.
I20260618 19:57:00.298066 3077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0447960184714aaf886ca15b9aa0e63a" is_pre_election: true
I20260618 19:57:00.299060 3077 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acc600e5aa44409ea3ce4c2861cb4de1 in term 0.
W20260618 19:57:00.323673 3230 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260618 19:57:00.333400 3230 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260618 19:57:00.358355 3199 raft_consensus.cc:515] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:00.359314 3199 leader_election.cc:290] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [CANDIDATE]: Term 1 election: Requested vote from peers 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955), 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975)
I20260618 19:57:00.362942 3077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0447960184714aaf886ca15b9aa0e63a"
I20260618 19:57:00.363220 3077 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:00.367421 3148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c13c838eb85465090e1bff0df28912f"
I20260618 19:57:00.367663 3148 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:00.456589 3148 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acc600e5aa44409ea3ce4c2861cb4de1 in term 1.
I20260618 19:57:00.457542 2983 leader_election.cc:304] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f, acc600e5aa44409ea3ce4c2861cb4de1; no voters:
I20260618 19:57:00.457967 3199 raft_consensus.cc:2804] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 19:57:00.459614 3077 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acc600e5aa44409ea3ce4c2861cb4de1 in term 1.
I20260618 19:57:00.468099 3199 raft_consensus.cc:697] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 1 LEADER]: Becoming Leader. State: Replica: acc600e5aa44409ea3ce4c2861cb4de1, State: Running, Role: LEADER
I20260618 19:57:00.468938 3199 consensus_queue.cc:237] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:00.472819 3034 master_runner.cc:264] No leader master found from master 0447960184714aaf886ca15b9aa0e63a
I20260618 19:57:00.472967 3034 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260618 19:57:00.474025 3233 sys_catalog.cc:455] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader acc600e5aa44409ea3ce4c2861cb4de1. Latest consensus state: current_term: 1 leader_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:00.474654 3233 sys_catalog.cc:458] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [sys.catalog]: This master's current role is: LEADER
I20260618 19:57:00.475827 3235 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260618 19:57:00.482540 3235 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260618 19:57:00.503726 3148 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 1 FOLLOWER]: Refusing update from remote peer acc600e5aa44409ea3ce4c2861cb4de1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 19:57:00.503726 3077 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 1 FOLLOWER]: Refusing update from remote peer acc600e5aa44409ea3ce4c2861cb4de1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 19:57:00.504930 3233 consensus_queue.cc:1048] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:00.505327 3199 consensus_queue.cc:1048] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260618 19:57:00.531843 3056 tablet.cc:2406] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260618 19:57:00.539069 3216 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: SysCatalogTable state changed. Reason: New leader acc600e5aa44409ea3ce4c2861cb4de1. Latest consensus state: current_term: 1 leader_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:00.539350 3216 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: This master's current role is: FOLLOWER
I20260618 19:57:00.549348 3237 mvcc.cc:204] Tried to move back new op lower bound from 7298304493568864256 to 7298304493450190848. Current Snapshot: MvccSnapshot[applied={T|T < 7298304493568864256}]
I20260618 19:57:00.551137 3181 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: SysCatalogTable state changed. Reason: New leader acc600e5aa44409ea3ce4c2861cb4de1. Latest consensus state: current_term: 1 leader_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:00.551433 3181 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: This master's current role is: FOLLOWER
I20260618 19:57:00.565304 3199 sys_catalog.cc:455] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:00.566591 3199 sys_catalog.cc:458] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [sys.catalog]: This master's current role is: LEADER
I20260618 19:57:00.567059 3199 sys_catalog.cc:455] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:00.567240 3199 sys_catalog.cc:458] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [sys.catalog]: This master's current role is: LEADER
I20260618 19:57:00.578125 3181 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:00.578392 3181 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: This master's current role is: FOLLOWER
I20260618 19:57:00.578825 3216 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:00.579005 3216 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: This master's current role is: FOLLOWER
I20260618 19:57:00.579416 3235 catalog_manager.cc:1382] Generated new cluster ID: 2cd457c38b944bab8903c2f58018327f
I20260618 19:57:00.579528 3235 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260618 19:57:00.628582 3235 catalog_manager.cc:1405] Generated new certificate authority record
I20260618 19:57:00.630988 3235 catalog_manager.cc:1539] Loading token signing keys...
I20260618 19:57:00.654814 3235 catalog_manager.cc:6069] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1: Generated new TSK 0
I20260618 19:57:00.656503 3235 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260618 19:57:00.657917 3235 catalog_manager.cc:1562] Loading latest processed Hive Metastore notification log event ID...
I20260618 19:57:00.659125 3235 catalog_manager.cc:5918] Last processed Hive Metastore notification event ID: -1
I20260618 19:57:00.671563 2682 external_mini_cluster.cc:1372] Running /tmp/dist-test-task_3iVrE/build/asan/bin/kudu
/tmp/dist-test-task_3iVrE/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.158.129:0
--local_ip_for_outbound_sockets=127.2.158.129
--webserver_interface=127.2.158.129
--webserver_port=0
--tserver_master_addrs=127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975
--builtin_ntp_servers=127.2.158.148:40109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260618 19:57:01.154986 3246 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader acc600e5aa44409ea3ce4c2861cb4de1)
I20260618 19:57:01.155191 3246 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:01.156697 3246 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
I20260618 19:57:01.157349 3076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c13c838eb85465090e1bff0df28912f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0447960184714aaf886ca15b9aa0e63a" is_pre_election: true
I20260618 19:57:01.157513 3007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c13c838eb85465090e1bff0df28912f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" is_pre_election: true
I20260618 19:57:01.158278 3122 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:01.158674 3246 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260618 19:57:01.175315 3195 catalog_manager.cc:1294] Loaded cluster ID: 2cd457c38b944bab8903c2f58018327f
I20260618 19:57:01.175437 3195 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: loading cluster ID for follower catalog manager: success
I20260618 19:57:01.178619 3195 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: acquiring CA information for follower catalog manager: success
I20260618 19:57:01.180476 3195 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260618 19:57:01.186774 3245 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 19:57:01.187085 3245 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 19:57:01.187237 3245 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260618 19:57:01.197790 3245 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260618 19:57:01.198026 3245 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.158.129
I20260618 19:57:01.209827 3245 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.158.148:40109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.158.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.158.129
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.158.129
--log_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 18 Jun 2026 19:43:24 UTC on bdcb31816ec0
build id 12458
ASAN enabled
I20260618 19:57:01.211570 3245 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 19:57:01.213629 3245 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260618 19:57:01.223932 3254 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 19:57:01.223934 3252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 19:57:01.224061 3251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 19:57:01.225147 3245 server_base.cc:1061] running on GCE node
I20260618 19:57:01.225805 3245 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 19:57:01.227241 3245 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 19:57:01.228562 3245 hybrid_clock.cc:648] HybridClock initialized: now 1781812621228511 us; error 31 us; skew 500 ppm
I20260618 19:57:01.228940 3245 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260618 19:57:01.231564 3245 webserver.cc:533] Webserver started at http://127.2.158.129:44961/ using document root <none> and password file <none>
I20260618 19:57:01.232429 3245 fs_manager.cc:362] Metadata directory not provided
I20260618 19:57:01.232533 3245 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 19:57:01.232941 3245 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 19:57:01.235746 3245 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-0/data/instance:
uuid: "51c7777f264b496a9bf9511966dcfbd7"
format_stamp: "Formatted at 2026-06-18 19:57:01 on dist-test-slave-6zlr"
I20260618 19:57:01.236573 3245 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-0/wal/instance:
uuid: "51c7777f264b496a9bf9511966dcfbd7"
format_stamp: "Formatted at 2026-06-18 19:57:01 on dist-test-slave-6zlr"
I20260618 19:57:01.242663 3245 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260618 19:57:01.246742 3260 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 19:57:01.248322 3245 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260618 19:57:01.248502 3245 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-0/data,/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-0/wal
uuid: "51c7777f264b496a9bf9511966dcfbd7"
format_stamp: "Formatted at 2026-06-18 19:57:01 on dist-test-slave-6zlr"
I20260618 19:57:01.248826 3245 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 19:57:01.302078 3245 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 19:57:01.303066 3245 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 19:57:01.303344 3245 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 19:57:01.304868 3245 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260618 19:57:01.306726 3245 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 19:57:01.306882 3245 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 19:57:01.306990 3245 ts_tablet_manager.cc:616] Registered 0 tablets
I20260618 19:57:01.307067 3245 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 19:57:01.336225 3230 catalog_manager.cc:1294] Loaded cluster ID: 2cd457c38b944bab8903c2f58018327f
I20260618 19:57:01.336347 3230 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: loading cluster ID for follower catalog manager: success
I20260618 19:57:01.341243 3230 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: acquiring CA information for follower catalog manager: success
I20260618 19:57:01.344627 3230 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260618 19:57:01.359210 3245 rpc_server.cc:307] RPC server started. Bound to: 127.2.158.129:44205
I20260618 19:57:01.359299 3372 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.158.129:44205 every 8 connection(s)
I20260618 19:57:01.360785 3245 server_base.cc:1193] Dumped server information to /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-0/data/info.pb
I20260618 19:57:01.370755 2682 external_mini_cluster.cc:1434] Started /tmp/dist-test-task_3iVrE/build/asan/bin/kudu as pid 3245
I20260618 19:57:01.371124 2682 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-0/wal/instance
I20260618 19:57:01.390048 2682 external_mini_cluster.cc:1372] Running /tmp/dist-test-task_3iVrE/build/asan/bin/kudu
/tmp/dist-test-task_3iVrE/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.158.130:0
--local_ip_for_outbound_sockets=127.2.158.130
--webserver_interface=127.2.158.130
--webserver_port=0
--tserver_master_addrs=127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975
--builtin_ntp_servers=127.2.158.148:40109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260618 19:57:01.396409 3375 heartbeater.cc:344] Connected to a master server at 127.2.158.189:45955
I20260618 19:57:01.396871 3375 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:01.398497 3373 heartbeater.cc:344] Connected to a master server at 127.2.158.190:41233
I20260618 19:57:01.398659 3375 heartbeater.cc:507] Master 127.2.158.189:45955 requested a full tablet report, sending...
I20260618 19:57:01.398751 3373 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:01.399675 3373 heartbeater.cc:507] Master 127.2.158.190:41233 requested a full tablet report, sending...
I20260618 19:57:01.401894 3066 ts_manager.cc:194] Registered new tserver with Master: 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205)
I20260618 19:57:01.402771 2996 ts_manager.cc:194] Registered new tserver with Master: 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205)
I20260618 19:57:01.403851 3374 heartbeater.cc:344] Connected to a master server at 127.2.158.188:34975
I20260618 19:57:01.404011 3374 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:01.404600 3374 heartbeater.cc:507] Master 127.2.158.188:34975 requested a full tablet report, sending...
I20260618 19:57:01.404664 2996 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.2.158.129:42455
I20260618 19:57:01.406515 3138 ts_manager.cc:194] Registered new tserver with Master: 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205)
I20260618 19:57:01.626189 3384 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader acc600e5aa44409ea3ce4c2861cb4de1)
I20260618 19:57:01.626437 3384 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:01.627797 3384 leader_election.cc:290] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975)
I20260618 19:57:01.628422 3147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0447960184714aaf886ca15b9aa0e63a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c13c838eb85465090e1bff0df28912f" is_pre_election: true
I20260618 19:57:01.628453 3007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0447960184714aaf886ca15b9aa0e63a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" is_pre_election: true
I20260618 19:57:01.629115 3053 leader_election.cc:304] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0447960184714aaf886ca15b9aa0e63a; no voters: 6c13c838eb85465090e1bff0df28912f, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:01.629518 3384 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260618 19:57:01.710562 3385 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader acc600e5aa44409ea3ce4c2861cb4de1)
I20260618 19:57:01.710774 3385 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:01.711534 3385 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
I20260618 19:57:01.712221 3076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c13c838eb85465090e1bff0df28912f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0447960184714aaf886ca15b9aa0e63a" is_pre_election: true
I20260618 19:57:01.714972 3007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c13c838eb85465090e1bff0df28912f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" is_pre_election: true
I20260618 19:57:01.715603 3122 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:01.715878 3385 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260618 19:57:01.786618 3383 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 19:57:01.786985 3383 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 19:57:01.787123 3383 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260618 19:57:01.796756 3383 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260618 19:57:01.797044 3383 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.158.130
I20260618 19:57:01.808483 3383 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.158.148:40109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.158.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.158.130
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.158.130
--log_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 18 Jun 2026 19:43:24 UTC on bdcb31816ec0
build id 12458
ASAN enabled
I20260618 19:57:01.810236 3383 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 19:57:01.812119 3383 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260618 19:57:01.826056 3391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 19:57:01.826777 3390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 19:57:01.827044 3393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 19:57:01.828394 3383 server_base.cc:1061] running on GCE node
I20260618 19:57:01.829165 3383 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 19:57:01.830344 3383 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 19:57:01.831576 3383 hybrid_clock.cc:648] HybridClock initialized: now 1781812621831541 us; error 29 us; skew 500 ppm
I20260618 19:57:01.831916 3383 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260618 19:57:01.834453 3383 webserver.cc:533] Webserver started at http://127.2.158.130:41201/ using document root <none> and password file <none>
I20260618 19:57:01.835348 3383 fs_manager.cc:362] Metadata directory not provided
I20260618 19:57:01.835491 3383 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 19:57:01.835917 3383 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 19:57:01.838635 3383 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-1/data/instance:
uuid: "722df47a60ca4bfa82104dea57718f3b"
format_stamp: "Formatted at 2026-06-18 19:57:01 on dist-test-slave-6zlr"
I20260618 19:57:01.839615 3383 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-1/wal/instance:
uuid: "722df47a60ca4bfa82104dea57718f3b"
format_stamp: "Formatted at 2026-06-18 19:57:01 on dist-test-slave-6zlr"
I20260618 19:57:01.845999 3383 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260618 19:57:01.850082 3399 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 19:57:01.851863 3383 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260618 19:57:01.852051 3383 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-1/data,/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-1/wal
uuid: "722df47a60ca4bfa82104dea57718f3b"
format_stamp: "Formatted at 2026-06-18 19:57:01 on dist-test-slave-6zlr"
I20260618 19:57:01.852283 3383 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 19:57:01.867270 3383 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 19:57:01.868139 3383 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 19:57:01.868420 3383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 19:57:01.869921 3383 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260618 19:57:01.871692 3383 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 19:57:01.871783 3383 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 19:57:01.871925 3383 ts_tablet_manager.cc:616] Registered 0 tablets
I20260618 19:57:01.871994 3383 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 19:57:01.908111 3373 heartbeater.cc:499] Master 127.2.158.190:41233 was elected leader, sending a full tablet report...
I20260618 19:57:01.913992 3383 rpc_server.cc:307] RPC server started. Bound to: 127.2.158.130:34483
I20260618 19:57:01.914042 3511 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.158.130:34483 every 8 connection(s)
I20260618 19:57:01.915405 3383 server_base.cc:1193] Dumped server information to /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-1/data/info.pb
I20260618 19:57:01.917554 2682 external_mini_cluster.cc:1434] Started /tmp/dist-test-task_3iVrE/build/asan/bin/kudu as pid 3383
I20260618 19:57:01.917783 2682 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-1/wal/instance
I20260618 19:57:01.926496 2682 external_mini_cluster.cc:1372] Running /tmp/dist-test-task_3iVrE/build/asan/bin/kudu
/tmp/dist-test-task_3iVrE/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.158.131:0
--local_ip_for_outbound_sockets=127.2.158.131
--webserver_interface=127.2.158.131
--webserver_port=0
--tserver_master_addrs=127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975
--builtin_ntp_servers=127.2.158.148:40109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260618 19:57:01.941731 3512 heartbeater.cc:344] Connected to a master server at 127.2.158.190:41233
I20260618 19:57:01.942251 3512 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:01.943384 3512 heartbeater.cc:507] Master 127.2.158.190:41233 requested a full tablet report, sending...
I20260618 19:57:01.943799 3514 heartbeater.cc:344] Connected to a master server at 127.2.158.189:45955
I20260618 19:57:01.943967 3514 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:01.944468 3513 heartbeater.cc:344] Connected to a master server at 127.2.158.188:34975
I20260618 19:57:01.944551 3514 heartbeater.cc:507] Master 127.2.158.189:45955 requested a full tablet report, sending...
I20260618 19:57:01.944595 3513 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:01.945137 3513 heartbeater.cc:507] Master 127.2.158.188:34975 requested a full tablet report, sending...
I20260618 19:57:01.945776 3066 ts_manager.cc:194] Registered new tserver with Master: 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483)
I20260618 19:57:01.946135 3138 ts_manager.cc:194] Registered new tserver with Master: 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483)
I20260618 19:57:01.946672 2996 ts_manager.cc:194] Registered new tserver with Master: 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483)
I20260618 19:57:01.947438 2996 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.2.158.130:60287
I20260618 19:57:02.206941 3523 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader acc600e5aa44409ea3ce4c2861cb4de1)
I20260618 19:57:02.207181 3523 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:02.207973 3523 leader_election.cc:290] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975)
I20260618 19:57:02.208496 3007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0447960184714aaf886ca15b9aa0e63a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" is_pre_election: true
I20260618 19:57:02.209227 3147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0447960184714aaf886ca15b9aa0e63a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6c13c838eb85465090e1bff0df28912f" is_pre_election: true
I20260618 19:57:02.210072 3053 leader_election.cc:304] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0447960184714aaf886ca15b9aa0e63a; no voters: 6c13c838eb85465090e1bff0df28912f, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:02.210489 3523 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260618 19:57:02.278750 3524 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader acc600e5aa44409ea3ce4c2861cb4de1)
I20260618 19:57:02.278967 3524 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:02.279657 3524 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
I20260618 19:57:02.280268 3007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c13c838eb85465090e1bff0df28912f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" is_pre_election: true
I20260618 19:57:02.280313 3076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c13c838eb85465090e1bff0df28912f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0447960184714aaf886ca15b9aa0e63a" is_pre_election: true
I20260618 19:57:02.280501 3076 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c13c838eb85465090e1bff0df28912f in term 1.
I20260618 19:57:02.280956 3124 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0447960184714aaf886ca15b9aa0e63a, 6c13c838eb85465090e1bff0df28912f; no voters: acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:02.281237 3524 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260618 19:57:02.281414 3524 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 1 FOLLOWER]: Starting leader election (detected failure of leader acc600e5aa44409ea3ce4c2861cb4de1)
I20260618 19:57:02.281518 3524 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 1 FOLLOWER]: Advancing to term 2
I20260618 19:57:02.284564 3524 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:02.285439 3524 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 2 election: Requested vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
I20260618 19:57:02.286141 3007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c13c838eb85465090e1bff0df28912f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "acc600e5aa44409ea3ce4c2861cb4de1"
I20260618 19:57:02.286310 3076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c13c838eb85465090e1bff0df28912f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0447960184714aaf886ca15b9aa0e63a"
I20260618 19:57:02.286536 3076 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 1 FOLLOWER]: Advancing to term 2
I20260618 19:57:02.288722 3076 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c13c838eb85465090e1bff0df28912f in term 2.
I20260618 19:57:02.289247 3124 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0447960184714aaf886ca15b9aa0e63a, 6c13c838eb85465090e1bff0df28912f; no voters: acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:02.289770 3524 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 2 FOLLOWER]: Leader election won for term 2
I20260618 19:57:02.290247 3524 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 2 LEADER]: Becoming Leader. State: Replica: 6c13c838eb85465090e1bff0df28912f, State: Running, Role: LEADER
I20260618 19:57:02.290753 3524 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:02.293203 3525 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c13c838eb85465090e1bff0df28912f. Latest consensus state: current_term: 2 leader_uuid: "6c13c838eb85465090e1bff0df28912f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:02.293555 3525 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: This master's current role is: LEADER
I20260618 19:57:02.294240 3527 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260618 19:57:02.296491 3527 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260618 19:57:02.297976 3527 catalog_manager.cc:1294] Loaded cluster ID: 2cd457c38b944bab8903c2f58018327f
I20260618 19:57:02.298107 3527 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260618 19:57:02.299821 3527 catalog_manager.cc:1539] Loading token signing keys...
I20260618 19:57:02.303472 3147 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 2 LEADER]: Rejecting Update request from peer acc600e5aa44409ea3ce4c2861cb4de1 for earlier term 1. Current term is 2. Ops: []
I20260618 19:57:02.303910 3527 catalog_manager.cc:6080] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: Loaded TSK: 0
I20260618 19:57:02.304270 3528 consensus_queue.cc:1059] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260618 19:57:02.305160 3527 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260618 19:57:02.306727 3527 catalog_manager.cc:1562] Loading latest processed Hive Metastore notification log event ID...
I20260618 19:57:02.306947 3528 consensus_queue.cc:1243] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [LEADER]: Peer 6c13c838eb85465090e1bff0df28912f log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260618 19:57:02.307165 3529 raft_consensus.cc:3055] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 1 LEADER]: Stepping down as leader of term 1
I20260618 19:57:02.307340 3529 raft_consensus.cc:740] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: acc600e5aa44409ea3ce4c2861cb4de1, State: Running, Role: LEADER
I20260618 19:57:02.307745 3527 catalog_manager.cc:5918] Last processed Hive Metastore notification event ID: -1
I20260618 19:57:02.307812 3529 consensus_queue.cc:260] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:02.308696 3529 raft_consensus.cc:3060] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 1 FOLLOWER]: Advancing to term 2
W20260618 19:57:02.321378 3520 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 19:57:02.321692 3520 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 19:57:02.321789 3520 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260618 19:57:02.331961 3520 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260618 19:57:02.332161 3520 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.158.131
I20260618 19:57:02.344013 3520 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.158.148:40109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.158.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.158.131
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.158.131
--log_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 18 Jun 2026 19:43:24 UTC on bdcb31816ec0
build id 12458
ASAN enabled
I20260618 19:57:02.345826 3520 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 19:57:02.347625 3520 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260618 19:57:02.358397 3534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 19:57:02.358350 3535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 19:57:02.359089 3537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 19:57:02.362665 3520 server_base.cc:1061] running on GCE node
I20260618 19:57:02.363252 3520 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 19:57:02.364355 3520 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 19:57:02.365615 3520 hybrid_clock.cc:648] HybridClock initialized: now 1781812622365564 us; error 44 us; skew 500 ppm
I20260618 19:57:02.365903 3520 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260618 19:57:02.368247 3520 webserver.cc:533] Webserver started at http://127.2.158.131:38601/ using document root <none> and password file <none>
I20260618 19:57:02.368999 3520 fs_manager.cc:362] Metadata directory not provided
I20260618 19:57:02.369089 3520 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 19:57:02.369469 3520 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 19:57:02.372200 3520 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/data/instance:
uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1"
format_stamp: "Formatted at 2026-06-18 19:57:02 on dist-test-slave-6zlr"
I20260618 19:57:02.373240 3520 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/wal/instance:
uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1"
format_stamp: "Formatted at 2026-06-18 19:57:02 on dist-test-slave-6zlr"
I20260618 19:57:02.378952 3520 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260618 19:57:02.382400 3543 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 19:57:02.383881 3520 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260618 19:57:02.384034 3520 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/data,/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/wal
uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1"
format_stamp: "Formatted at 2026-06-18 19:57:02 on dist-test-slave-6zlr"
I20260618 19:57:02.384240 3520 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 19:57:02.424634 3520 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 19:57:02.425611 3520 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 19:57:02.425882 3520 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 19:57:02.426856 3520 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260618 19:57:02.428615 3520 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 19:57:02.428728 3520 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 19:57:02.428821 3520 ts_tablet_manager.cc:616] Registered 0 tablets
I20260618 19:57:02.428880 3520 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 19:57:02.449892 3512 heartbeater.cc:499] Master 127.2.158.190:41233 was elected leader, sending a full tablet report...
I20260618 19:57:02.474442 3520 rpc_server.cc:307] RPC server started. Bound to: 127.2.158.131:33071
I20260618 19:57:02.474501 3655 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.158.131:33071 every 8 connection(s)
I20260618 19:57:02.475986 3520 server_base.cc:1193] Dumped server information to /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/data/info.pb
I20260618 19:57:02.486126 2682 external_mini_cluster.cc:1434] Started /tmp/dist-test-task_3iVrE/build/asan/bin/kudu as pid 3520
I20260618 19:57:02.486346 2682 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/wal/instance
I20260618 19:57:02.493613 3657 heartbeater.cc:344] Connected to a master server at 127.2.158.188:34975
I20260618 19:57:02.494063 3657 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:02.495069 3657 heartbeater.cc:507] Master 127.2.158.188:34975 requested a full tablet report, sending...
I20260618 19:57:02.497558 3656 heartbeater.cc:344] Connected to a master server at 127.2.158.190:41233
I20260618 19:57:02.497573 3138 ts_manager.cc:194] Registered new tserver with Master: 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:02.497702 3656 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:02.498204 3656 heartbeater.cc:507] Master 127.2.158.190:41233 requested a full tablet report, sending...
I20260618 19:57:02.499136 3138 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.2.158.131:41857
I20260618 19:57:02.499363 2996 ts_manager.cc:194] Registered new tserver with Master: 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:02.500829 3658 heartbeater.cc:344] Connected to a master server at 127.2.158.189:45955
I20260618 19:57:02.500988 3658 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:02.501329 3658 heartbeater.cc:507] Master 127.2.158.189:45955 requested a full tablet report, sending...
I20260618 19:57:02.502293 3066 ts_manager.cc:194] Registered new tserver with Master: 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:02.516680 2682 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260618 19:57:02.557595 3138 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50578:
name: "default.Table_402627eeff7b4c338e64cfbe575411be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:02.557723 3136 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50578:
name: "default.Table_77c95317631d4b1eab1943139e888ecb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:02.558418 3137 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50578:
name: "default.Table_8a3fffa237bc419e8921a2b75f70e639"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:02.561383 3135 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50578:
name: "default.Table_736a38f9f9fe4dc7aed9092c9b7b33cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:02.565631 3133 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50578:
name: "default.Table_e1e6b231bd514a58a66b66d04eff6e48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:02.568260 3132 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50578:
name: "default.Table_28d033357fdb4b29b0abfeebb5ef122b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:02.570511 3134 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50578:
name: "default.Table_39c8f72f53c5475bb66b72b21bd13991"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:02.570604 3131 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50578:
name: "default.Table_4f9cd241b4284c4796f2aba3ccec0e35"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 19:57:02.571687 3138 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_402627eeff7b4c338e64cfbe575411be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 19:57:02.571632 3130 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50578:
name: "default.Table_b11e5cb8e5194655b89a8452d2eb25f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:02.572814 3129 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50578:
name: "default.Table_4957212a0ca5452e98630b441906262f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 19:57:02.575479 3137 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_8a3fffa237bc419e8921a2b75f70e639 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260618 19:57:02.576534 3136 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_77c95317631d4b1eab1943139e888ecb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260618 19:57:02.577492 3135 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_736a38f9f9fe4dc7aed9092c9b7b33cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260618 19:57:02.578436 3133 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_e1e6b231bd514a58a66b66d04eff6e48 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 19:57:02.607447 2682 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task_3iVrE/build/asan/bin/kudu pid 3105
I20260618 19:57:02.610596 3168 generic_service.cc:196] Checking for leaks (request via RPC)
I20260618 19:57:02.788642 2682 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task_3iVrE/build/asan/bin/kudu with pid 3105
I20260618 19:57:02.800375 3529 raft_consensus.cc:493] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:02.800616 3529 raft_consensus.cc:515] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:02.801539 3529 leader_election.cc:290] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955), 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975)
I20260618 19:57:02.802479 3076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0447960184714aaf886ca15b9aa0e63a" is_pre_election: true
I20260618 19:57:02.802740 3076 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acc600e5aa44409ea3ce4c2861cb4de1 in term 2.
I20260618 19:57:02.803342 2983 leader_election.cc:304] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1; no voters:
I20260618 19:57:02.803738 3529 raft_consensus.cc:2804] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260618 19:57:02.803853 3529 raft_consensus.cc:493] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 19:57:02.803938 3529 raft_consensus.cc:3060] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 2 FOLLOWER]: Advancing to term 3
I20260618 19:57:02.807444 3529 raft_consensus.cc:515] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:02.808869 3076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0447960184714aaf886ca15b9aa0e63a"
I20260618 19:57:02.809091 3076 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 2 FOLLOWER]: Advancing to term 3
I20260618 19:57:02.812336 3076 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acc600e5aa44409ea3ce4c2861cb4de1 in term 3.
I20260618 19:57:02.812991 2983 leader_election.cc:304] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1; no voters:
I20260618 19:57:02.814738 3529 leader_election.cc:290] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [CANDIDATE]: Term 3 election: Requested vote from peers 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955), 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975)
I20260618 19:57:02.815388 3529 raft_consensus.cc:2804] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 3 FOLLOWER]: Leader election won for term 3
I20260618 19:57:02.815882 3529 raft_consensus.cc:697] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 3 LEADER]: Becoming Leader. State: Replica: acc600e5aa44409ea3ce4c2861cb4de1, State: Running, Role: LEADER
I20260618 19:57:02.816354 3529 consensus_queue.cc:237] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
W20260618 19:57:02.831125 3668 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.2.158.188:34975)
I20260618 19:57:02.831120 3707 sys_catalog.cc:455] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader acc600e5aa44409ea3ce4c2861cb4de1. Latest consensus state: current_term: 3 leader_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:02.831622 3707 sys_catalog.cc:458] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [sys.catalog]: This master's current role is: LEADER
W20260618 19:57:02.840334 2983 connection.cc:573] client connection to 127.2.158.188:34975 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260618 19:57:02.849728 3671 negotiation.cc:336] Failed RPC negotiation. Trace:
0618 19:57:02.833123 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.2.158.188:34975 (local address 127.0.0.1:50584)
0618 19:57:02.833459 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0618 19:57:02.833480 (+ 21us) client_negotiation.cc:175] Beginning negotiation
0618 19:57:02.833655 (+ 175us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0618 19:57:02.847678 (+ 14023us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.158.188:34975: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":67}
I20260618 19:57:02.857161 3709 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260618 19:57:02.860378 3709 catalog_manager.cc:1519] Initializing Kudu cluster ID...
W20260618 19:57:02.860555 2983 leader_election.cc:336] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975): Network error: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111)
W20260618 19:57:02.860924 2983 leader_election.cc:336] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975): Network error: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111)
I20260618 19:57:02.861588 3709 catalog_manager.cc:1294] Loaded cluster ID: 2cd457c38b944bab8903c2f58018327f
I20260618 19:57:02.861668 3709 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260618 19:57:02.863402 3709 catalog_manager.cc:1539] Loading token signing keys...
I20260618 19:57:02.864565 3709 catalog_manager.cc:6080] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1: Loaded TSK: 0
I20260618 19:57:02.865476 3709 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260618 19:57:02.866420 3709 catalog_manager.cc:1562] Loading latest processed Hive Metastore notification log event ID...
I20260618 19:57:02.867350 3709 catalog_manager.cc:5918] Last processed Hive Metastore notification event ID: -1
I20260618 19:57:02.875531 2996 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50008:
name: "default.Table_4957212a0ca5452e98630b441906262f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:02.876547 2997 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50008:
name: "default.Table_b11e5cb8e5194655b89a8452d2eb25f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:02.877115 2995 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50008:
name: "default.Table_4f9cd241b4284c4796f2aba3ccec0e35"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:02.877792 2988 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50008:
name: "default.Table_e1e6b231bd514a58a66b66d04eff6e48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:02.878401 2989 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50008:
name: "default.Table_39c8f72f53c5475bb66b72b21bd13991"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:02.878978 2994 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50008:
name: "default.Table_28d033357fdb4b29b0abfeebb5ef122b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:02.879518 2993 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50008:
name: "default.Table_8a3fffa237bc419e8921a2b75f70e639"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:02.880264 2992 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50008:
name: "default.Table_402627eeff7b4c338e64cfbe575411be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:02.880800 2991 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50008:
name: "default.Table_77c95317631d4b1eab1943139e888ecb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:02.881243 2990 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50008:
name: "default.Table_736a38f9f9fe4dc7aed9092c9b7b33cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 19:57:02.888928 2996 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_4957212a0ca5452e98630b441906262f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260618 19:57:02.891558 2997 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_b11e5cb8e5194655b89a8452d2eb25f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 19:57:02.912710 3374 heartbeater.cc:499] Master 127.2.158.188:34975 was elected leader, sending a full tablet report...
W20260618 19:57:02.938510 3374 heartbeater.cc:646] Failed to heartbeat to 127.2.158.188:34975 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111)
I20260618 19:57:02.952042 3513 heartbeater.cc:499] Master 127.2.158.188:34975 was elected leader, sending a full tablet report...
W20260618 19:57:02.967672 3513 heartbeater.cc:646] Failed to heartbeat to 127.2.158.188:34975 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111)
I20260618 19:57:03.001921 3657 heartbeater.cc:499] Master 127.2.158.188:34975 was elected leader, sending a full tablet report...
W20260618 19:57:03.011087 3657 heartbeater.cc:646] Failed to heartbeat to 127.2.158.188:34975 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111)
I20260618 19:57:03.140892 2996 catalog_manager.cc:2199] created HMS catalog entry for table [id=749b241f59b34125a9ff8d7c847ddd3d]
I20260618 19:57:03.152246 3076 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 3 FOLLOWER]: Refusing update from remote peer acc600e5aa44409ea3ce4c2861cb4de1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260618 19:57:03.153291 3707 consensus_queue.cc:1048] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260618 19:57:03.153828 2983 consensus_peers.cc:597] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 -> Peer 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975): Couldn't send request to peer 6c13c838eb85465090e1bff0df28912f. Status: Network error: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260618 19:57:03.189337 3716 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: SysCatalogTable state changed. Reason: New leader acc600e5aa44409ea3ce4c2861cb4de1. Latest consensus state: current_term: 3 leader_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:03.189616 3716 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: This master's current role is: FOLLOWER
I20260618 19:57:03.201792 3529 sys_catalog.cc:455] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:03.202068 3529 sys_catalog.cc:458] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [sys.catalog]: This master's current role is: LEADER
I20260618 19:57:03.204787 3716 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:03.205039 3716 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: This master's current role is: FOLLOWER
I20260618 19:57:03.212147 2996 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:50008:
table { table_name: "default.Table_4957212a0ca5452e98630b441906262f" } new_table_name: "default.Table_972741ac692e4b0797a3406e734bb4d4" modify_external_catalogs: true
I20260618 19:57:03.217974 2997 catalog_manager.cc:2199] created HMS catalog entry for table [id=b3a217a305294496bd2ad3d3eed4e179]
W20260618 19:57:03.225968 2995 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_4f9cd241b4284c4796f2aba3ccec0e35 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260618 19:57:03.227667 2988 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_e1e6b231bd514a58a66b66d04eff6e48 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260618 19:57:03.229140 2989 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_39c8f72f53c5475bb66b72b21bd13991 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260618 19:57:03.230237 2994 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_28d033357fdb4b29b0abfeebb5ef122b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260618 19:57:03.231245 2993 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_8a3fffa237bc419e8921a2b75f70e639 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260618 19:57:03.232237 2992 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_402627eeff7b4c338e64cfbe575411be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260618 19:57:03.233232 2991 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_77c95317631d4b1eab1943139e888ecb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260618 19:57:03.234647 2990 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_736a38f9f9fe4dc7aed9092c9b7b33cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 19:57:03.260257 3447 tablet_service.cc:1511] Processing CreateTablet for tablet f4e809df951843bc925fccd879ca0469 (DEFAULT_TABLE table=default.table_4957212a0ca5452e98630b441906262f [id=749b241f59b34125a9ff8d7c847ddd3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:03.262135 3447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4e809df951843bc925fccd879ca0469. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:03.264812 3591 tablet_service.cc:1511] Processing CreateTablet for tablet f4e809df951843bc925fccd879ca0469 (DEFAULT_TABLE table=default.table_4957212a0ca5452e98630b441906262f [id=749b241f59b34125a9ff8d7c847ddd3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:03.266461 3591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4e809df951843bc925fccd879ca0469. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:03.276890 3729 tablet_bootstrap.cc:492] T f4e809df951843bc925fccd879ca0469 P 722df47a60ca4bfa82104dea57718f3b: Bootstrap starting.
I20260618 19:57:03.281589 3729 tablet_bootstrap.cc:654] T f4e809df951843bc925fccd879ca0469 P 722df47a60ca4bfa82104dea57718f3b: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:03.281136 3308 tablet_service.cc:1511] Processing CreateTablet for tablet f4e809df951843bc925fccd879ca0469 (DEFAULT_TABLE table=default.table_4957212a0ca5452e98630b441906262f [id=749b241f59b34125a9ff8d7c847ddd3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:03.282974 3308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4e809df951843bc925fccd879ca0469. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:03.290441 3729 log.cc:826] T f4e809df951843bc925fccd879ca0469 P 722df47a60ca4bfa82104dea57718f3b: Log is configured to *not* fsync() on all Append() calls
I20260618 19:57:03.312074 3730 tablet_bootstrap.cc:492] T f4e809df951843bc925fccd879ca0469 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Bootstrap starting.
I20260618 19:57:03.315997 3730 tablet_bootstrap.cc:654] T f4e809df951843bc925fccd879ca0469 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:03.316519 3732 tablet_bootstrap.cc:492] T f4e809df951843bc925fccd879ca0469 P 51c7777f264b496a9bf9511966dcfbd7: Bootstrap starting.
I20260618 19:57:03.317512 3730 log.cc:826] T f4e809df951843bc925fccd879ca0469 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Log is configured to *not* fsync() on all Append() calls
I20260618 19:57:03.327680 3730 tablet_bootstrap.cc:492] T f4e809df951843bc925fccd879ca0469 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: No bootstrap required, opened a new log
I20260618 19:57:03.327998 3730 ts_tablet_manager.cc:1403] T f4e809df951843bc925fccd879ca0469 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.009s
I20260618 19:57:03.329943 3729 tablet_bootstrap.cc:492] T f4e809df951843bc925fccd879ca0469 P 722df47a60ca4bfa82104dea57718f3b: No bootstrap required, opened a new log
I20260618 19:57:03.329952 3732 tablet_bootstrap.cc:654] T f4e809df951843bc925fccd879ca0469 P 51c7777f264b496a9bf9511966dcfbd7: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:03.330343 3729 ts_tablet_manager.cc:1403] T f4e809df951843bc925fccd879ca0469 P 722df47a60ca4bfa82104dea57718f3b: Time spent bootstrapping tablet: real 0.054s user 0.006s sys 0.009s
I20260618 19:57:03.331248 3732 log.cc:826] T f4e809df951843bc925fccd879ca0469 P 51c7777f264b496a9bf9511966dcfbd7: Log is configured to *not* fsync() on all Append() calls
I20260618 19:57:03.335469 3730 raft_consensus.cc:359] T f4e809df951843bc925fccd879ca0469 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:03.335906 3730 raft_consensus.cc:385] T f4e809df951843bc925fccd879ca0469 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:03.336017 3730 raft_consensus.cc:740] T f4e809df951843bc925fccd879ca0469 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb3ca8239f4412fb8b0e7d0df9e50c1, State: Initialized, Role: FOLLOWER
I20260618 19:57:03.338423 3729 raft_consensus.cc:359] T f4e809df951843bc925fccd879ca0469 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:03.338976 3729 raft_consensus.cc:385] T f4e809df951843bc925fccd879ca0469 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:03.339128 3729 raft_consensus.cc:740] T f4e809df951843bc925fccd879ca0469 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 722df47a60ca4bfa82104dea57718f3b, State: Initialized, Role: FOLLOWER
I20260618 19:57:03.342072 3730 consensus_queue.cc:260] T f4e809df951843bc925fccd879ca0469 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:03.342303 3729 consensus_queue.cc:260] T f4e809df951843bc925fccd879ca0469 P 722df47a60ca4bfa82104dea57718f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:03.343926 3732 tablet_bootstrap.cc:492] T f4e809df951843bc925fccd879ca0469 P 51c7777f264b496a9bf9511966dcfbd7: No bootstrap required, opened a new log
I20260618 19:57:03.344313 3732 ts_tablet_manager.cc:1403] T f4e809df951843bc925fccd879ca0469 P 51c7777f264b496a9bf9511966dcfbd7: Time spent bootstrapping tablet: real 0.028s user 0.009s sys 0.000s
I20260618 19:57:03.347205 3656 heartbeater.cc:499] Master 127.2.158.190:41233 was elected leader, sending a full tablet report...
I20260618 19:57:03.347527 3730 ts_tablet_manager.cc:1434] T f4e809df951843bc925fccd879ca0469 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent starting tablet: real 0.019s user 0.014s sys 0.001s
I20260618 19:57:03.347707 3729 ts_tablet_manager.cc:1434] T f4e809df951843bc925fccd879ca0469 P 722df47a60ca4bfa82104dea57718f3b: Time spent starting tablet: real 0.017s user 0.010s sys 0.003s
I20260618 19:57:03.353605 2995 catalog_manager.cc:2199] created HMS catalog entry for table [id=873b29232cab4ad9a9f8c070455c98a9]
I20260618 19:57:03.354099 3732 raft_consensus.cc:359] T f4e809df951843bc925fccd879ca0469 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:03.354529 3732 raft_consensus.cc:385] T f4e809df951843bc925fccd879ca0469 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:03.354635 3732 raft_consensus.cc:740] T f4e809df951843bc925fccd879ca0469 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51c7777f264b496a9bf9511966dcfbd7, State: Initialized, Role: FOLLOWER
I20260618 19:57:03.355350 3732 consensus_queue.cc:260] T f4e809df951843bc925fccd879ca0469 P 51c7777f264b496a9bf9511966dcfbd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:03.360728 3512 heartbeater.cc:499] Master 127.2.158.190:41233 was elected leader, sending a full tablet report...
I20260618 19:57:03.377350 2997 master_service.cc:960] ReplaceTablet: received request to replace tablet f4e809df951843bc925fccd879ca0469 from {username='slave'} at 127.0.0.1:50008
I20260618 19:57:03.384076 3373 heartbeater.cc:499] Master 127.2.158.190:41233 was elected leader, sending a full tablet report...
I20260618 19:57:03.384796 3732 ts_tablet_manager.cc:1434] T f4e809df951843bc925fccd879ca0469 P 51c7777f264b496a9bf9511966dcfbd7: Time spent starting tablet: real 0.040s user 0.021s sys 0.018s
I20260618 19:57:03.395926 3308 tablet_service.cc:1511] Processing CreateTablet for tablet 6dcdf661fe344b90bb6002d07206bd53 (DEFAULT_TABLE table=default.table_b11e5cb8e5194655b89a8452d2eb25f5 [id=b3a217a305294496bd2ad3d3eed4e179]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:03.396492 3308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dcdf661fe344b90bb6002d07206bd53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:03.399644 3591 tablet_service.cc:1511] Processing CreateTablet for tablet 6dcdf661fe344b90bb6002d07206bd53 (DEFAULT_TABLE table=default.table_b11e5cb8e5194655b89a8452d2eb25f5 [id=b3a217a305294496bd2ad3d3eed4e179]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:03.399963 3447 tablet_service.cc:1511] Processing CreateTablet for tablet 6dcdf661fe344b90bb6002d07206bd53 (DEFAULT_TABLE table=default.table_b11e5cb8e5194655b89a8452d2eb25f5 [id=b3a217a305294496bd2ad3d3eed4e179]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:03.400104 3591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dcdf661fe344b90bb6002d07206bd53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:03.400357 3447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dcdf661fe344b90bb6002d07206bd53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:03.410775 3307 tablet_service.cc:1511] Processing CreateTablet for tablet 1e5805a1516f4adbb12c67decfa3352f (DEFAULT_TABLE table=default.table_4f9cd241b4284c4796f2aba3ccec0e35 [id=873b29232cab4ad9a9f8c070455c98a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:03.411386 3307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e5805a1516f4adbb12c67decfa3352f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:03.414014 3446 tablet_service.cc:1511] Processing CreateTablet for tablet 1e5805a1516f4adbb12c67decfa3352f (DEFAULT_TABLE table=default.table_4f9cd241b4284c4796f2aba3ccec0e35 [id=873b29232cab4ad9a9f8c070455c98a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:03.414619 3446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e5805a1516f4adbb12c67decfa3352f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:03.419517 3732 tablet_bootstrap.cc:492] T 6dcdf661fe344b90bb6002d07206bd53 P 51c7777f264b496a9bf9511966dcfbd7: Bootstrap starting.
I20260618 19:57:03.421711 3732 tablet_bootstrap.cc:654] T 6dcdf661fe344b90bb6002d07206bd53 P 51c7777f264b496a9bf9511966dcfbd7: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:03.422546 3729 tablet_bootstrap.cc:492] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b: Bootstrap starting.
I20260618 19:57:03.424451 3729 tablet_bootstrap.cc:654] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b: Neither blocks nor log segments found. Creating new log.
W20260618 19:57:03.426559 3515 tablet.cc:2406] T f4e809df951843bc925fccd879ca0469 P 722df47a60ca4bfa82104dea57718f3b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260618 19:57:03.427845 3730 tablet_bootstrap.cc:492] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Bootstrap starting.
I20260618 19:57:03.430248 3730 tablet_bootstrap.cc:654] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:03.431906 3591 tablet_service.cc:1511] Processing CreateTablet for tablet 1e5805a1516f4adbb12c67decfa3352f (DEFAULT_TABLE table=default.table_4f9cd241b4284c4796f2aba3ccec0e35 [id=873b29232cab4ad9a9f8c070455c98a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:03.432390 3591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e5805a1516f4adbb12c67decfa3352f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:03.434424 3732 tablet_bootstrap.cc:492] T 6dcdf661fe344b90bb6002d07206bd53 P 51c7777f264b496a9bf9511966dcfbd7: No bootstrap required, opened a new log
I20260618 19:57:03.434721 3732 ts_tablet_manager.cc:1403] T 6dcdf661fe344b90bb6002d07206bd53 P 51c7777f264b496a9bf9511966dcfbd7: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.003s
I20260618 19:57:03.436157 3732 raft_consensus.cc:359] T 6dcdf661fe344b90bb6002d07206bd53 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.436465 3732 raft_consensus.cc:385] T 6dcdf661fe344b90bb6002d07206bd53 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:03.436592 3732 raft_consensus.cc:740] T 6dcdf661fe344b90bb6002d07206bd53 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51c7777f264b496a9bf9511966dcfbd7, State: Initialized, Role: FOLLOWER
I20260618 19:57:03.436838 2997 catalog_manager.cc:5983] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1: Sending DeleteTablet for 3 replicas of tablet f4e809df951843bc925fccd879ca0469
I20260618 19:57:03.436933 3732 consensus_queue.cc:260] T 6dcdf661fe344b90bb6002d07206bd53 P 51c7777f264b496a9bf9511966dcfbd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.437611 2997 catalog_manager.cc:6784] ReplaceTablet: tablet f4e809df951843bc925fccd879ca0469 deleted and replaced by tablet 59b33f9c5c494332a5892a1a1ef9672d
I20260618 19:57:03.437719 3732 ts_tablet_manager.cc:1434] T 6dcdf661fe344b90bb6002d07206bd53 P 51c7777f264b496a9bf9511966dcfbd7: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260618 19:57:03.438154 3732 tablet_bootstrap.cc:492] T 1e5805a1516f4adbb12c67decfa3352f P 51c7777f264b496a9bf9511966dcfbd7: Bootstrap starting.
I20260618 19:57:03.440263 2995 master_service.cc:960] ReplaceTablet: received request to replace tablet f4e809df951843bc925fccd879ca0469 from {username='slave'} at 127.0.0.1:50008
I20260618 19:57:03.440688 3732 tablet_bootstrap.cc:654] T 1e5805a1516f4adbb12c67decfa3352f P 51c7777f264b496a9bf9511966dcfbd7: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:03.440704 2995 master_service.cc:960] ReplaceTablet: received request to replace tablet f4e809df951843bc925fccd879ca0469 from {username='slave'} at 127.0.0.1:50008
I20260618 19:57:03.441078 2995 master_service.cc:960] ReplaceTablet: received request to replace tablet f4e809df951843bc925fccd879ca0469 from {username='slave'} at 127.0.0.1:50008
I20260618 19:57:03.441505 2995 master_service.cc:960] ReplaceTablet: received request to replace tablet f4e809df951843bc925fccd879ca0469 from {username='slave'} at 127.0.0.1:50008
I20260618 19:57:03.441974 2995 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:50008:
table { table_name: "default.Table_b11e5cb8e5194655b89a8452d2eb25f5" } new_table_name: "default.Table_9fbf373ce2cc4af6949381c591b56ca1" modify_external_catalogs: true
I20260618 19:57:03.442586 2997 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:50008:
table { table_name: "default.Table_4f9cd241b4284c4796f2aba3ccec0e35" } new_table_name: "default.Table_09ffd657f7864eb4a23acb264281460c" modify_external_catalogs: true
I20260618 19:57:03.446894 3307 tablet_service.cc:1558] Processing DeleteTablet for tablet f4e809df951843bc925fccd879ca0469 with delete_type TABLET_DATA_DELETED (replaced by tablet 59b33f9c5c494332a5892a1a1ef9672d) from {username='slave'} at 127.0.0.1:39210
I20260618 19:57:03.449396 3590 tablet_service.cc:1558] Processing DeleteTablet for tablet f4e809df951843bc925fccd879ca0469 with delete_type TABLET_DATA_DELETED (replaced by tablet 59b33f9c5c494332a5892a1a1ef9672d) from {username='slave'} at 127.0.0.1:44288
I20260618 19:57:03.450695 3447 tablet_service.cc:1558] Processing DeleteTablet for tablet f4e809df951843bc925fccd879ca0469 with delete_type TABLET_DATA_DELETED (replaced by tablet 59b33f9c5c494332a5892a1a1ef9672d) from {username='slave'} at 127.0.0.1:36324
I20260618 19:57:03.451684 3729 tablet_bootstrap.cc:492] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b: No bootstrap required, opened a new log
I20260618 19:57:03.451917 3729 ts_tablet_manager.cc:1403] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b: Time spent bootstrapping tablet: real 0.029s user 0.009s sys 0.001s
I20260618 19:57:03.460163 3589 tablet_service.cc:1511] Processing CreateTablet for tablet 59b33f9c5c494332a5892a1a1ef9672d (DEFAULT_TABLE table=default.table_4957212a0ca5452e98630b441906262f [id=749b241f59b34125a9ff8d7c847ddd3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:03.460502 3308 tablet_service.cc:1511] Processing CreateTablet for tablet 59b33f9c5c494332a5892a1a1ef9672d (DEFAULT_TABLE table=default.table_4957212a0ca5452e98630b441906262f [id=749b241f59b34125a9ff8d7c847ddd3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:03.460759 3589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59b33f9c5c494332a5892a1a1ef9672d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:03.461041 3308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59b33f9c5c494332a5892a1a1ef9672d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:03.462760 3446 tablet_service.cc:1511] Processing CreateTablet for tablet 59b33f9c5c494332a5892a1a1ef9672d (DEFAULT_TABLE table=default.table_4957212a0ca5452e98630b441906262f [id=749b241f59b34125a9ff8d7c847ddd3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:03.463236 3446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59b33f9c5c494332a5892a1a1ef9672d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:03.469484 3729 raft_consensus.cc:359] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.469861 3729 raft_consensus.cc:385] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:03.470003 3729 raft_consensus.cc:740] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 722df47a60ca4bfa82104dea57718f3b, State: Initialized, Role: FOLLOWER
I20260618 19:57:03.470409 3729 consensus_queue.cc:260] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.473194 3729 ts_tablet_manager.cc:1434] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b: Time spent starting tablet: real 0.021s user 0.003s sys 0.000s
I20260618 19:57:03.473608 3729 tablet_bootstrap.cc:492] T 6dcdf661fe344b90bb6002d07206bd53 P 722df47a60ca4bfa82104dea57718f3b: Bootstrap starting.
I20260618 19:57:03.474673 3730 tablet_bootstrap.cc:492] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: No bootstrap required, opened a new log
I20260618 19:57:03.474845 3730 ts_tablet_manager.cc:1403] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent bootstrapping tablet: real 0.047s user 0.012s sys 0.006s
I20260618 19:57:03.475826 3730 raft_consensus.cc:359] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.476007 3730 raft_consensus.cc:385] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:03.476084 3730 raft_consensus.cc:740] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb3ca8239f4412fb8b0e7d0df9e50c1, State: Initialized, Role: FOLLOWER
I20260618 19:57:03.476303 3730 consensus_queue.cc:260] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.476783 3730 ts_tablet_manager.cc:1434] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260618 19:57:03.478943 3730 tablet_bootstrap.cc:492] T 1e5805a1516f4adbb12c67decfa3352f P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Bootstrap starting.
I20260618 19:57:03.480844 3730 tablet_bootstrap.cc:654] T 1e5805a1516f4adbb12c67decfa3352f P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:03.483650 3729 tablet_bootstrap.cc:654] T 6dcdf661fe344b90bb6002d07206bd53 P 722df47a60ca4bfa82104dea57718f3b: Neither blocks nor log segments found. Creating new log.
W20260618 19:57:03.486508 3659 tablet.cc:2406] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260618 19:57:03.486722 3730 tablet_bootstrap.cc:492] T 1e5805a1516f4adbb12c67decfa3352f P 6bb3ca8239f4412fb8b0e7d0df9e50c1: No bootstrap required, opened a new log
I20260618 19:57:03.486907 3730 ts_tablet_manager.cc:1403] T 1e5805a1516f4adbb12c67decfa3352f P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260618 19:57:03.487691 3730 raft_consensus.cc:359] T 1e5805a1516f4adbb12c67decfa3352f P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.487907 3730 raft_consensus.cc:385] T 1e5805a1516f4adbb12c67decfa3352f P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:03.488005 3730 raft_consensus.cc:740] T 1e5805a1516f4adbb12c67decfa3352f P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb3ca8239f4412fb8b0e7d0df9e50c1, State: Initialized, Role: FOLLOWER
I20260618 19:57:03.488293 3730 consensus_queue.cc:260] T 1e5805a1516f4adbb12c67decfa3352f P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.488891 3730 ts_tablet_manager.cc:1434] T 1e5805a1516f4adbb12c67decfa3352f P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260618 19:57:03.489233 3730 tablet_bootstrap.cc:492] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Bootstrap starting.
I20260618 19:57:03.491065 3730 tablet_bootstrap.cc:654] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:03.502437 2988 catalog_manager.cc:2199] created HMS catalog entry for table [id=5a73fe372e7f47b49ed9219558f0194e]
I20260618 19:57:03.503247 3730 tablet_bootstrap.cc:492] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1: No bootstrap required, opened a new log
I20260618 19:57:03.503393 3730 ts_tablet_manager.cc:1403] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260618 19:57:03.504207 3730 raft_consensus.cc:359] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.504405 3730 raft_consensus.cc:385] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:03.504482 3730 raft_consensus.cc:740] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb3ca8239f4412fb8b0e7d0df9e50c1, State: Initialized, Role: FOLLOWER
I20260618 19:57:03.504712 3730 consensus_queue.cc:260] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.505167 3730 ts_tablet_manager.cc:1434] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260618 19:57:03.510421 3735 raft_consensus.cc:493] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:03.510710 3735 raft_consensus.cc:515] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.523067 3735 leader_election.cc:290] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483)
I20260618 19:57:03.527791 3467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dcdf661fe344b90bb6002d07206bd53" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "722df47a60ca4bfa82104dea57718f3b" is_pre_election: true
W20260618 19:57:03.529515 3547 leader_election.cc:343] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483): Illegal state: must be running to vote when last-logged opid is not known
I20260618 19:57:03.532838 3446 tablet_service.cc:1511] Processing CreateTablet for tablet 9b509a2b95f6457d90f68990d272b8fc (DEFAULT_TABLE table=default.table_e1e6b231bd514a58a66b66d04eff6e48 [id=5a73fe372e7f47b49ed9219558f0194e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:03.533492 3446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b509a2b95f6457d90f68990d272b8fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:03.534113 3306 tablet_service.cc:1511] Processing CreateTablet for tablet 9b509a2b95f6457d90f68990d272b8fc (DEFAULT_TABLE table=default.table_e1e6b231bd514a58a66b66d04eff6e48 [id=5a73fe372e7f47b49ed9219558f0194e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:03.534901 3306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b509a2b95f6457d90f68990d272b8fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:03.541519 2988 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50008:
name: "default.Table_0711d10accfd429788e8e459cacc6139"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:03.548322 3589 tablet_service.cc:1511] Processing CreateTablet for tablet 9b509a2b95f6457d90f68990d272b8fc (DEFAULT_TABLE table=default.table_e1e6b231bd514a58a66b66d04eff6e48 [id=5a73fe372e7f47b49ed9219558f0194e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:03.548827 3589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b509a2b95f6457d90f68990d272b8fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:03.555985 3730 tablet_bootstrap.cc:492] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Bootstrap starting.
I20260618 19:57:03.558308 3730 tablet_bootstrap.cc:654] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:03.562755 3328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dcdf661fe344b90bb6002d07206bd53" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7" is_pre_election: true
I20260618 19:57:03.563431 3328 raft_consensus.cc:2468] T 6dcdf661fe344b90bb6002d07206bd53 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 0.
I20260618 19:57:03.571017 3546 leader_election.cc:304] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7, 6bb3ca8239f4412fb8b0e7d0df9e50c1; no voters: 722df47a60ca4bfa82104dea57718f3b
I20260618 19:57:03.571591 3735 raft_consensus.cc:2804] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 19:57:03.571779 3735 raft_consensus.cc:493] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 19:57:03.571902 3735 raft_consensus.cc:3060] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:03.575946 3735 raft_consensus.cc:515] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.579239 3735 leader_election.cc:290] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 election: Requested vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483)
I20260618 19:57:03.579967 3467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dcdf661fe344b90bb6002d07206bd53" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "722df47a60ca4bfa82104dea57718f3b"
W20260618 19:57:03.580758 3547 leader_election.cc:343] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483): Illegal state: must be running to vote when last-logged opid is not known
I20260618 19:57:03.582978 3328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dcdf661fe344b90bb6002d07206bd53" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7"
I20260618 19:57:03.583451 3328 raft_consensus.cc:3060] T 6dcdf661fe344b90bb6002d07206bd53 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:03.588455 3328 raft_consensus.cc:2468] T 6dcdf661fe344b90bb6002d07206bd53 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 1.
I20260618 19:57:03.590377 3744 tablet_replica.cc:333] T f4e809df951843bc925fccd879ca0469 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: stopping tablet replica
I20260618 19:57:03.591085 3744 raft_consensus.cc:2243] T f4e809df951843bc925fccd879ca0469 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260618 19:57:03.591636 3744 raft_consensus.cc:2272] T f4e809df951843bc925fccd879ca0469 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:03.592624 3745 tablet_replica.cc:333] T f4e809df951843bc925fccd879ca0469 P 722df47a60ca4bfa82104dea57718f3b: stopping tablet replica
I20260618 19:57:03.593096 3745 raft_consensus.cc:2243] T f4e809df951843bc925fccd879ca0469 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260618 19:57:03.593605 3745 raft_consensus.cc:2272] T f4e809df951843bc925fccd879ca0469 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:03.594662 3743 tablet_replica.cc:333] T f4e809df951843bc925fccd879ca0469 P 51c7777f264b496a9bf9511966dcfbd7: stopping tablet replica
I20260618 19:57:03.595088 3743 raft_consensus.cc:2243] T f4e809df951843bc925fccd879ca0469 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260618 19:57:03.595471 3743 raft_consensus.cc:2272] T f4e809df951843bc925fccd879ca0469 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:03.596423 3546 leader_election.cc:304] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7, 6bb3ca8239f4412fb8b0e7d0df9e50c1; no voters: 722df47a60ca4bfa82104dea57718f3b
I20260618 19:57:03.596792 3735 raft_consensus.cc:2804] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 19:57:03.597500 3743 ts_tablet_manager.cc:1916] T f4e809df951843bc925fccd879ca0469 P 51c7777f264b496a9bf9511966dcfbd7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:03.598047 3744 ts_tablet_manager.cc:1916] T f4e809df951843bc925fccd879ca0469 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:03.598363 3745 ts_tablet_manager.cc:1916] T f4e809df951843bc925fccd879ca0469 P 722df47a60ca4bfa82104dea57718f3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:03.597767 3732 tablet_bootstrap.cc:492] T 1e5805a1516f4adbb12c67decfa3352f P 51c7777f264b496a9bf9511966dcfbd7: No bootstrap required, opened a new log
I20260618 19:57:03.599993 3732 ts_tablet_manager.cc:1403] T 1e5805a1516f4adbb12c67decfa3352f P 51c7777f264b496a9bf9511966dcfbd7: Time spent bootstrapping tablet: real 0.162s user 0.014s sys 0.024s
I20260618 19:57:03.601357 3732 raft_consensus.cc:359] T 1e5805a1516f4adbb12c67decfa3352f P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.601658 3732 raft_consensus.cc:385] T 1e5805a1516f4adbb12c67decfa3352f P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:03.601769 3732 raft_consensus.cc:740] T 1e5805a1516f4adbb12c67decfa3352f P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51c7777f264b496a9bf9511966dcfbd7, State: Initialized, Role: FOLLOWER
I20260618 19:57:03.602236 3732 consensus_queue.cc:260] T 1e5805a1516f4adbb12c67decfa3352f P 51c7777f264b496a9bf9511966dcfbd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.603773 3735 raft_consensus.cc:697] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 LEADER]: Becoming Leader. State: Replica: 6bb3ca8239f4412fb8b0e7d0df9e50c1, State: Running, Role: LEADER
I20260618 19:57:03.605372 3732 ts_tablet_manager.cc:1434] T 1e5805a1516f4adbb12c67decfa3352f P 51c7777f264b496a9bf9511966dcfbd7: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260618 19:57:03.605808 3735 consensus_queue.cc:237] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.607331 3732 tablet_bootstrap.cc:492] T 9b509a2b95f6457d90f68990d272b8fc P 51c7777f264b496a9bf9511966dcfbd7: Bootstrap starting.
I20260618 19:57:03.610441 3732 tablet_bootstrap.cc:654] T 9b509a2b95f6457d90f68990d272b8fc P 51c7777f264b496a9bf9511966dcfbd7: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:03.612222 3729 tablet_bootstrap.cc:492] T 6dcdf661fe344b90bb6002d07206bd53 P 722df47a60ca4bfa82104dea57718f3b: No bootstrap required, opened a new log
I20260618 19:57:03.612460 3729 ts_tablet_manager.cc:1403] T 6dcdf661fe344b90bb6002d07206bd53 P 722df47a60ca4bfa82104dea57718f3b: Time spent bootstrapping tablet: real 0.139s user 0.032s sys 0.059s
I20260618 19:57:03.613198 3729 raft_consensus.cc:359] T 6dcdf661fe344b90bb6002d07206bd53 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.613481 3729 raft_consensus.cc:385] T 6dcdf661fe344b90bb6002d07206bd53 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:03.613596 3729 raft_consensus.cc:740] T 6dcdf661fe344b90bb6002d07206bd53 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 722df47a60ca4bfa82104dea57718f3b, State: Initialized, Role: FOLLOWER
I20260618 19:57:03.614470 3729 consensus_queue.cc:260] T 6dcdf661fe344b90bb6002d07206bd53 P 722df47a60ca4bfa82104dea57718f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.617820 3729 ts_tablet_manager.cc:1434] T 6dcdf661fe344b90bb6002d07206bd53 P 722df47a60ca4bfa82104dea57718f3b: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260618 19:57:03.620157 3729 tablet_bootstrap.cc:492] T 59b33f9c5c494332a5892a1a1ef9672d P 722df47a60ca4bfa82104dea57718f3b: Bootstrap starting.
W20260618 19:57:03.622437 3376 tablet.cc:2406] T 1e5805a1516f4adbb12c67decfa3352f P 51c7777f264b496a9bf9511966dcfbd7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260618 19:57:03.622800 3730 tablet_bootstrap.cc:492] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1: No bootstrap required, opened a new log
I20260618 19:57:03.623005 3730 ts_tablet_manager.cc:1403] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent bootstrapping tablet: real 0.067s user 0.021s sys 0.014s
I20260618 19:57:03.624639 3730 raft_consensus.cc:359] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:03.625159 3730 raft_consensus.cc:385] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:03.625351 3730 raft_consensus.cc:740] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb3ca8239f4412fb8b0e7d0df9e50c1, State: Initialized, Role: FOLLOWER
I20260618 19:57:03.626932 3730 consensus_queue.cc:260] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:03.627584 3729 tablet_bootstrap.cc:654] T 59b33f9c5c494332a5892a1a1ef9672d P 722df47a60ca4bfa82104dea57718f3b: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:03.628553 3730 ts_tablet_manager.cc:1434] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260618 19:57:03.632884 3743 ts_tablet_manager.cc:1929] T f4e809df951843bc925fccd879ca0469 P 51c7777f264b496a9bf9511966dcfbd7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260618 19:57:03.630509 3745 ts_tablet_manager.cc:1929] T f4e809df951843bc925fccd879ca0469 P 722df47a60ca4bfa82104dea57718f3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260618 19:57:03.633351 3745 log.cc:1199] T f4e809df951843bc925fccd879ca0469 P 722df47a60ca4bfa82104dea57718f3b: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-1/wal/wals/f4e809df951843bc925fccd879ca0469
I20260618 19:57:03.633950 3745 ts_tablet_manager.cc:1950] T f4e809df951843bc925fccd879ca0469 P 722df47a60ca4bfa82104dea57718f3b: Deleting consensus metadata
I20260618 19:57:03.634181 3743 log.cc:1199] T f4e809df951843bc925fccd879ca0469 P 51c7777f264b496a9bf9511966dcfbd7: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-0/wal/wals/f4e809df951843bc925fccd879ca0469
I20260618 19:57:03.634716 3743 ts_tablet_manager.cc:1950] T f4e809df951843bc925fccd879ca0469 P 51c7777f264b496a9bf9511966dcfbd7: Deleting consensus metadata
I20260618 19:57:03.637082 2984 catalog_manager.cc:5027] TS 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483): tablet f4e809df951843bc925fccd879ca0469 (table default.table_4957212a0ca5452e98630b441906262f [id=749b241f59b34125a9ff8d7c847ddd3d]) successfully deleted
I20260618 19:57:03.639029 2983 catalog_manager.cc:5027] TS 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205): tablet f4e809df951843bc925fccd879ca0469 (table default.table_4957212a0ca5452e98630b441906262f [id=749b241f59b34125a9ff8d7c847ddd3d]) successfully deleted
I20260618 19:57:03.639818 3732 tablet_bootstrap.cc:492] T 9b509a2b95f6457d90f68990d272b8fc P 51c7777f264b496a9bf9511966dcfbd7: No bootstrap required, opened a new log
I20260618 19:57:03.639997 3732 ts_tablet_manager.cc:1403] T 9b509a2b95f6457d90f68990d272b8fc P 51c7777f264b496a9bf9511966dcfbd7: Time spent bootstrapping tablet: real 0.033s user 0.005s sys 0.000s
I20260618 19:57:03.640923 3732 raft_consensus.cc:359] T 9b509a2b95f6457d90f68990d272b8fc P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:03.641144 3732 raft_consensus.cc:385] T 9b509a2b95f6457d90f68990d272b8fc P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:03.641297 3732 raft_consensus.cc:740] T 9b509a2b95f6457d90f68990d272b8fc P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51c7777f264b496a9bf9511966dcfbd7, State: Initialized, Role: FOLLOWER
I20260618 19:57:03.641563 3732 consensus_queue.cc:260] T 9b509a2b95f6457d90f68990d272b8fc P 51c7777f264b496a9bf9511966dcfbd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:03.642865 3732 ts_tablet_manager.cc:1434] T 9b509a2b95f6457d90f68990d272b8fc P 51c7777f264b496a9bf9511966dcfbd7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260618 19:57:03.643254 3732 tablet_bootstrap.cc:492] T 59b33f9c5c494332a5892a1a1ef9672d P 51c7777f264b496a9bf9511966dcfbd7: Bootstrap starting.
I20260618 19:57:03.645395 3732 tablet_bootstrap.cc:654] T 59b33f9c5c494332a5892a1a1ef9672d P 51c7777f264b496a9bf9511966dcfbd7: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:03.661217 3732 tablet_bootstrap.cc:492] T 59b33f9c5c494332a5892a1a1ef9672d P 51c7777f264b496a9bf9511966dcfbd7: No bootstrap required, opened a new log
I20260618 19:57:03.661553 3732 ts_tablet_manager.cc:1403] T 59b33f9c5c494332a5892a1a1ef9672d P 51c7777f264b496a9bf9511966dcfbd7: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.012s
I20260618 19:57:03.662400 3732 raft_consensus.cc:359] T 59b33f9c5c494332a5892a1a1ef9672d P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.662676 3732 raft_consensus.cc:385] T 59b33f9c5c494332a5892a1a1ef9672d P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:03.662779 3732 raft_consensus.cc:740] T 59b33f9c5c494332a5892a1a1ef9672d P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51c7777f264b496a9bf9511966dcfbd7, State: Initialized, Role: FOLLOWER
I20260618 19:57:03.663056 3732 consensus_queue.cc:260] T 59b33f9c5c494332a5892a1a1ef9672d P 51c7777f264b496a9bf9511966dcfbd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.663576 3732 ts_tablet_manager.cc:1434] T 59b33f9c5c494332a5892a1a1ef9672d P 51c7777f264b496a9bf9511966dcfbd7: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260618 19:57:03.668632 3744 ts_tablet_manager.cc:1929] T f4e809df951843bc925fccd879ca0469 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260618 19:57:03.670132 3729 tablet_bootstrap.cc:492] T 59b33f9c5c494332a5892a1a1ef9672d P 722df47a60ca4bfa82104dea57718f3b: No bootstrap required, opened a new log
I20260618 19:57:03.670115 3744 log.cc:1199] T f4e809df951843bc925fccd879ca0469 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/wal/wals/f4e809df951843bc925fccd879ca0469
I20260618 19:57:03.670293 3729 ts_tablet_manager.cc:1403] T 59b33f9c5c494332a5892a1a1ef9672d P 722df47a60ca4bfa82104dea57718f3b: Time spent bootstrapping tablet: real 0.050s user 0.011s sys 0.010s
I20260618 19:57:03.670778 3744 ts_tablet_manager.cc:1950] T f4e809df951843bc925fccd879ca0469 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting consensus metadata
I20260618 19:57:03.671228 3729 raft_consensus.cc:359] T 59b33f9c5c494332a5892a1a1ef9672d P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.671432 3729 raft_consensus.cc:385] T 59b33f9c5c494332a5892a1a1ef9672d P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:03.671531 3729 raft_consensus.cc:740] T 59b33f9c5c494332a5892a1a1ef9672d P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 722df47a60ca4bfa82104dea57718f3b, State: Initialized, Role: FOLLOWER
I20260618 19:57:03.671764 3729 consensus_queue.cc:260] T 59b33f9c5c494332a5892a1a1ef9672d P 722df47a60ca4bfa82104dea57718f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.672942 2984 catalog_manager.cc:5027] TS 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): tablet f4e809df951843bc925fccd879ca0469 (table default.table_4957212a0ca5452e98630b441906262f [id=749b241f59b34125a9ff8d7c847ddd3d]) successfully deleted
I20260618 19:57:03.674220 3729 ts_tablet_manager.cc:1434] T 59b33f9c5c494332a5892a1a1ef9672d P 722df47a60ca4bfa82104dea57718f3b: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260618 19:57:03.676194 3729 tablet_bootstrap.cc:492] T 9b509a2b95f6457d90f68990d272b8fc P 722df47a60ca4bfa82104dea57718f3b: Bootstrap starting.
I20260618 19:57:03.677649 3729 tablet_bootstrap.cc:654] T 9b509a2b95f6457d90f68990d272b8fc P 722df47a60ca4bfa82104dea57718f3b: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:03.685873 3729 tablet_bootstrap.cc:492] T 9b509a2b95f6457d90f68990d272b8fc P 722df47a60ca4bfa82104dea57718f3b: No bootstrap required, opened a new log
I20260618 19:57:03.686069 3729 ts_tablet_manager.cc:1403] T 9b509a2b95f6457d90f68990d272b8fc P 722df47a60ca4bfa82104dea57718f3b: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.001s
I20260618 19:57:03.686889 3729 raft_consensus.cc:359] T 9b509a2b95f6457d90f68990d272b8fc P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:03.687112 3729 raft_consensus.cc:385] T 9b509a2b95f6457d90f68990d272b8fc P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:03.687194 3729 raft_consensus.cc:740] T 9b509a2b95f6457d90f68990d272b8fc P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 722df47a60ca4bfa82104dea57718f3b, State: Initialized, Role: FOLLOWER
I20260618 19:57:03.687480 3729 consensus_queue.cc:260] T 9b509a2b95f6457d90f68990d272b8fc P 722df47a60ca4bfa82104dea57718f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:03.689868 3729 ts_tablet_manager.cc:1434] T 9b509a2b95f6457d90f68990d272b8fc P 722df47a60ca4bfa82104dea57718f3b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260618 19:57:03.692693 2989 catalog_manager.cc:2199] created HMS catalog entry for table [id=e13d5a8056214b30b410b665b7184922]
I20260618 19:57:03.702472 2989 catalog_manager.cc:5696] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131). New cstate: current_term: 1 leader_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } health_report { overall_health: HEALTHY } } }
I20260618 19:57:03.709576 3737 raft_consensus.cc:493] T 9b509a2b95f6457d90f68990d272b8fc P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:03.709803 3737 raft_consensus.cc:515] T 9b509a2b95f6457d90f68990d272b8fc P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:03.711871 3737 leader_election.cc:290] T 9b509a2b95f6457d90f68990d272b8fc P 51c7777f264b496a9bf9511966dcfbd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483), 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:03.712699 2682 external_mini_cluster.cc:1372] Running /tmp/dist-test-task_3iVrE/build/asan/bin/kudu
/tmp/dist-test-task_3iVrE/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.158.188:34975
--webserver_interface=127.2.158.188
--webserver_port=36245
--builtin_ntp_servers=127.2.158.148:40109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975
--hive_metastore_uris=thrift://127.0.0.1:43379
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260618 19:57:03.737488 3751 raft_consensus.cc:493] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:03.737668 3751 raft_consensus.cc:515] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:03.738619 3751 leader_election.cc:290] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483), 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205)
I20260618 19:57:03.739228 3328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b509a2b95f6457d90f68990d272b8fc" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7" is_pre_election: true
I20260618 19:57:03.739452 3328 raft_consensus.cc:2468] T 9b509a2b95f6457d90f68990d272b8fc P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 0.
I20260618 19:57:03.740171 3467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b509a2b95f6457d90f68990d272b8fc" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "722df47a60ca4bfa82104dea57718f3b" is_pre_election: true
I20260618 19:57:03.740490 3467 raft_consensus.cc:2468] T 9b509a2b95f6457d90f68990d272b8fc P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 0.
I20260618 19:57:03.741092 3546 leader_election.cc:304] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7, 6bb3ca8239f4412fb8b0e7d0df9e50c1; no voters:
I20260618 19:57:03.743180 3751 raft_consensus.cc:2804] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 19:57:03.743300 3751 raft_consensus.cc:493] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 19:57:03.743381 3751 raft_consensus.cc:3060] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:03.746233 3751 raft_consensus.cc:515] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:03.747644 3307 tablet_service.cc:1511] Processing CreateTablet for tablet 45d4e8e879f44a00bb9d84de8b3092dd (DEFAULT_TABLE table=default.table_39c8f72f53c5475bb66b72b21bd13991 [id=e13d5a8056214b30b410b665b7184922]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:03.748086 3307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d4e8e879f44a00bb9d84de8b3092dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:03.749485 2989 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:50008:
table { table_name: "default.Table_e1e6b231bd514a58a66b66d04eff6e48" } new_table_name: "default.Table_796d5677d78149a99894d70ce226919d" modify_external_catalogs: true
I20260618 19:57:03.752621 3732 tablet_bootstrap.cc:492] T 45d4e8e879f44a00bb9d84de8b3092dd P 51c7777f264b496a9bf9511966dcfbd7: Bootstrap starting.
I20260618 19:57:03.753414 3447 tablet_service.cc:1511] Processing CreateTablet for tablet 45d4e8e879f44a00bb9d84de8b3092dd (DEFAULT_TABLE table=default.table_39c8f72f53c5475bb66b72b21bd13991 [id=e13d5a8056214b30b410b665b7184922]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:03.753856 3447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d4e8e879f44a00bb9d84de8b3092dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:03.754333 3732 tablet_bootstrap.cc:654] T 45d4e8e879f44a00bb9d84de8b3092dd P 51c7777f264b496a9bf9511966dcfbd7: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:03.757841 3467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b509a2b95f6457d90f68990d272b8fc" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "722df47a60ca4bfa82104dea57718f3b"
I20260618 19:57:03.758101 3467 raft_consensus.cc:3060] T 9b509a2b95f6457d90f68990d272b8fc P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:03.762311 3590 tablet_service.cc:1511] Processing CreateTablet for tablet 45d4e8e879f44a00bb9d84de8b3092dd (DEFAULT_TABLE table=default.table_39c8f72f53c5475bb66b72b21bd13991 [id=e13d5a8056214b30b410b665b7184922]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:03.762926 3590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d4e8e879f44a00bb9d84de8b3092dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:03.764912 3732 tablet_bootstrap.cc:492] T 45d4e8e879f44a00bb9d84de8b3092dd P 51c7777f264b496a9bf9511966dcfbd7: No bootstrap required, opened a new log
I20260618 19:57:03.765053 3732 ts_tablet_manager.cc:1403] T 45d4e8e879f44a00bb9d84de8b3092dd P 51c7777f264b496a9bf9511966dcfbd7: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.007s
I20260618 19:57:03.765966 3732 raft_consensus.cc:359] T 45d4e8e879f44a00bb9d84de8b3092dd P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.766634 2994 catalog_manager.cc:2199] created HMS catalog entry for table [id=58a0cd369a884f1fb371a75c1794f738]
I20260618 19:57:03.770488 3732 raft_consensus.cc:385] T 45d4e8e879f44a00bb9d84de8b3092dd P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:03.770681 3732 raft_consensus.cc:740] T 45d4e8e879f44a00bb9d84de8b3092dd P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51c7777f264b496a9bf9511966dcfbd7, State: Initialized, Role: FOLLOWER
I20260618 19:57:03.770992 3732 consensus_queue.cc:260] T 45d4e8e879f44a00bb9d84de8b3092dd P 51c7777f264b496a9bf9511966dcfbd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.773541 3467 raft_consensus.cc:2468] T 9b509a2b95f6457d90f68990d272b8fc P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 1.
I20260618 19:57:03.774055 3547 leader_election.cc:304] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bb3ca8239f4412fb8b0e7d0df9e50c1, 722df47a60ca4bfa82104dea57718f3b; no voters:
I20260618 19:57:03.774353 3735 raft_consensus.cc:2804] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 19:57:03.778950 2994 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50008:
name: "default.Table_b536ea4ed5c945adb98d4d2c41448d70"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:03.789499 3736 raft_consensus.cc:493] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:03.789767 3736 raft_consensus.cc:515] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.791814 3736 leader_election.cc:290] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:03.792719 3729 tablet_bootstrap.cc:492] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b: Bootstrap starting.
I20260618 19:57:03.793754 3751 leader_election.cc:290] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 election: Requested vote from peers 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483), 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205)
I20260618 19:57:03.794281 3328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b509a2b95f6457d90f68990d272b8fc" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7"
I20260618 19:57:03.794495 3328 raft_consensus.cc:3060] T 9b509a2b95f6457d90f68990d272b8fc P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:03.794618 3729 tablet_bootstrap.cc:654] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:03.799216 3730 tablet_bootstrap.cc:492] T 45d4e8e879f44a00bb9d84de8b3092dd P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Bootstrap starting.
I20260618 19:57:03.801082 3730 tablet_bootstrap.cc:654] T 45d4e8e879f44a00bb9d84de8b3092dd P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:03.801935 3307 tablet_service.cc:1511] Processing CreateTablet for tablet 48c932d095ea475abc03d02def7e9a27 (DEFAULT_TABLE table=default.table_28d033357fdb4b29b0abfeebb5ef122b [id=58a0cd369a884f1fb371a75c1794f738]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:03.802537 3307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c932d095ea475abc03d02def7e9a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:03.804157 3328 raft_consensus.cc:2468] T 9b509a2b95f6457d90f68990d272b8fc P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 1.
I20260618 19:57:03.805703 3447 tablet_service.cc:1511] Processing CreateTablet for tablet 48c932d095ea475abc03d02def7e9a27 (DEFAULT_TABLE table=default.table_28d033357fdb4b29b0abfeebb5ef122b [id=58a0cd369a884f1fb371a75c1794f738]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:03.806214 3447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c932d095ea475abc03d02def7e9a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:03.809120 3328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e5805a1516f4adbb12c67decfa3352f" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7" is_pre_election: true
I20260618 19:57:03.809381 3328 raft_consensus.cc:2468] T 1e5805a1516f4adbb12c67decfa3352f P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 722df47a60ca4bfa82104dea57718f3b in term 0.
I20260618 19:57:03.809990 3402 leader_election.cc:304] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7, 722df47a60ca4bfa82104dea57718f3b; no voters:
I20260618 19:57:03.810449 3736 raft_consensus.cc:2804] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 19:57:03.810575 3736 raft_consensus.cc:493] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 19:57:03.810676 3736 raft_consensus.cc:3060] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:03.813457 3736 raft_consensus.cc:515] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.814677 3327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e5805a1516f4adbb12c67decfa3352f" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7"
I20260618 19:57:03.814978 3327 raft_consensus.cc:3060] T 1e5805a1516f4adbb12c67decfa3352f P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:03.818257 3327 raft_consensus.cc:2468] T 1e5805a1516f4adbb12c67decfa3352f P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 722df47a60ca4bfa82104dea57718f3b in term 1.
I20260618 19:57:03.819108 3402 leader_election.cc:304] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7, 722df47a60ca4bfa82104dea57718f3b; no voters:
I20260618 19:57:03.819424 3736 leader_election.cc:290] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 election: Requested vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:03.820353 3736 raft_consensus.cc:2804] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Leader election won for term 1
I20260618 19:57:03.820495 3736 raft_consensus.cc:697] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b [term 1 LEADER]: Becoming Leader. State: Replica: 722df47a60ca4bfa82104dea57718f3b, State: Running, Role: LEADER
I20260618 19:57:03.820990 3736 consensus_queue.cc:237] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.824827 3732 ts_tablet_manager.cc:1434] T 45d4e8e879f44a00bb9d84de8b3092dd P 51c7777f264b496a9bf9511966dcfbd7: Time spent starting tablet: real 0.060s user 0.002s sys 0.000s
I20260618 19:57:03.832759 3732 tablet_bootstrap.cc:492] T 48c932d095ea475abc03d02def7e9a27 P 51c7777f264b496a9bf9511966dcfbd7: Bootstrap starting.
I20260618 19:57:03.833593 3735 raft_consensus.cc:697] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 LEADER]: Becoming Leader. State: Replica: 6bb3ca8239f4412fb8b0e7d0df9e50c1, State: Running, Role: LEADER
I20260618 19:57:03.833932 3735 consensus_queue.cc:237] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:03.836648 3467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b509a2b95f6457d90f68990d272b8fc" candidate_uuid: "51c7777f264b496a9bf9511966dcfbd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "722df47a60ca4bfa82104dea57718f3b" is_pre_election: true
I20260618 19:57:03.837122 3467 raft_consensus.cc:2393] T 9b509a2b95f6457d90f68990d272b8fc P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51c7777f264b496a9bf9511966dcfbd7 in current term 1: Already voted for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in this term.
I20260618 19:57:03.838682 3730 tablet_bootstrap.cc:492] T 45d4e8e879f44a00bb9d84de8b3092dd P 6bb3ca8239f4412fb8b0e7d0df9e50c1: No bootstrap required, opened a new log
I20260618 19:57:03.838842 3730 ts_tablet_manager.cc:1403] T 45d4e8e879f44a00bb9d84de8b3092dd P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.007s
I20260618 19:57:03.839640 3730 raft_consensus.cc:359] T 45d4e8e879f44a00bb9d84de8b3092dd P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.839852 3730 raft_consensus.cc:385] T 45d4e8e879f44a00bb9d84de8b3092dd P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:03.839949 3730 raft_consensus.cc:740] T 45d4e8e879f44a00bb9d84de8b3092dd P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb3ca8239f4412fb8b0e7d0df9e50c1, State: Initialized, Role: FOLLOWER
I20260618 19:57:03.840122 3732 tablet_bootstrap.cc:654] T 48c932d095ea475abc03d02def7e9a27 P 51c7777f264b496a9bf9511966dcfbd7: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:03.840780 3730 consensus_queue.cc:260] T 45d4e8e879f44a00bb9d84de8b3092dd P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.845167 3730 ts_tablet_manager.cc:1434] T 45d4e8e879f44a00bb9d84de8b3092dd P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20260618 19:57:03.851617 3732 tablet_bootstrap.cc:492] T 48c932d095ea475abc03d02def7e9a27 P 51c7777f264b496a9bf9511966dcfbd7: No bootstrap required, opened a new log
I20260618 19:57:03.851644 3590 tablet_service.cc:1511] Processing CreateTablet for tablet 48c932d095ea475abc03d02def7e9a27 (DEFAULT_TABLE table=default.table_28d033357fdb4b29b0abfeebb5ef122b [id=58a0cd369a884f1fb371a75c1794f738]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:03.851804 3732 ts_tablet_manager.cc:1403] T 48c932d095ea475abc03d02def7e9a27 P 51c7777f264b496a9bf9511966dcfbd7: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20260618 19:57:03.852047 3590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c932d095ea475abc03d02def7e9a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:03.852654 3732 raft_consensus.cc:359] T 48c932d095ea475abc03d02def7e9a27 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:03.852837 3732 raft_consensus.cc:385] T 48c932d095ea475abc03d02def7e9a27 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:03.852901 3732 raft_consensus.cc:740] T 48c932d095ea475abc03d02def7e9a27 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51c7777f264b496a9bf9511966dcfbd7, State: Initialized, Role: FOLLOWER
I20260618 19:57:03.853152 3732 consensus_queue.cc:260] T 48c932d095ea475abc03d02def7e9a27 P 51c7777f264b496a9bf9511966dcfbd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:03.853662 3732 ts_tablet_manager.cc:1434] T 48c932d095ea475abc03d02def7e9a27 P 51c7777f264b496a9bf9511966dcfbd7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260618 19:57:03.856743 2993 catalog_manager.cc:2199] created HMS catalog entry for table [id=c256b56cd126492ea4f98f7d075e0a53]
I20260618 19:57:03.857245 3729 tablet_bootstrap.cc:492] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b: No bootstrap required, opened a new log
I20260618 19:57:03.857412 3729 ts_tablet_manager.cc:1403] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b: Time spent bootstrapping tablet: real 0.065s user 0.008s sys 0.004s
I20260618 19:57:03.857952 3610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e5805a1516f4adbb12c67decfa3352f" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1"
I20260618 19:57:03.858027 3609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b509a2b95f6457d90f68990d272b8fc" candidate_uuid: "51c7777f264b496a9bf9511966dcfbd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" is_pre_election: true
I20260618 19:57:03.858325 3610 raft_consensus.cc:3060] T 1e5805a1516f4adbb12c67decfa3352f P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:03.858822 3611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e5805a1516f4adbb12c67decfa3352f" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" is_pre_election: true
I20260618 19:57:03.859851 3264 leader_election.cc:304] T 9b509a2b95f6457d90f68990d272b8fc P 51c7777f264b496a9bf9511966dcfbd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7; no voters: 6bb3ca8239f4412fb8b0e7d0df9e50c1, 722df47a60ca4bfa82104dea57718f3b
I20260618 19:57:03.861392 3737 raft_consensus.cc:2749] T 9b509a2b95f6457d90f68990d272b8fc P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260618 19:57:03.861584 3610 raft_consensus.cc:2468] T 1e5805a1516f4adbb12c67decfa3352f P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 722df47a60ca4bfa82104dea57718f3b in term 1.
I20260618 19:57:03.862425 3729 raft_consensus.cc:359] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.862608 3729 raft_consensus.cc:385] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:03.862684 3729 raft_consensus.cc:740] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 722df47a60ca4bfa82104dea57718f3b, State: Initialized, Role: FOLLOWER
I20260618 19:57:03.862919 3729 consensus_queue.cc:260] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:03.863413 3729 ts_tablet_manager.cc:1434] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b: Time spent starting tablet: real 0.006s user 0.000s sys 0.000s
I20260618 19:57:03.863688 3729 tablet_bootstrap.cc:492] T 48c932d095ea475abc03d02def7e9a27 P 722df47a60ca4bfa82104dea57718f3b: Bootstrap starting.
I20260618 19:57:03.863687 3730 tablet_bootstrap.cc:492] T 48c932d095ea475abc03d02def7e9a27 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Bootstrap starting.
I20260618 19:57:03.865342 3729 tablet_bootstrap.cc:654] T 48c932d095ea475abc03d02def7e9a27 P 722df47a60ca4bfa82104dea57718f3b: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:03.865341 3730 tablet_bootstrap.cc:654] T 48c932d095ea475abc03d02def7e9a27 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:03.872193 2993 catalog_manager.cc:5696] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 722df47a60ca4bfa82104dea57718f3b (127.2.158.130). New cstate: current_term: 1 leader_uuid: "722df47a60ca4bfa82104dea57718f3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } health_report { overall_health: UNKNOWN } } }
I20260618 19:57:03.880153 3729 tablet_bootstrap.cc:492] T 48c932d095ea475abc03d02def7e9a27 P 722df47a60ca4bfa82104dea57718f3b: No bootstrap required, opened a new log
I20260618 19:57:03.880360 3729 ts_tablet_manager.cc:1403] T 48c932d095ea475abc03d02def7e9a27 P 722df47a60ca4bfa82104dea57718f3b: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.000s
I20260618 19:57:03.881224 3729 raft_consensus.cc:359] T 48c932d095ea475abc03d02def7e9a27 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:03.881449 3729 raft_consensus.cc:385] T 48c932d095ea475abc03d02def7e9a27 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:03.881532 3729 raft_consensus.cc:740] T 48c932d095ea475abc03d02def7e9a27 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 722df47a60ca4bfa82104dea57718f3b, State: Initialized, Role: FOLLOWER
I20260618 19:57:03.881794 3729 consensus_queue.cc:260] T 48c932d095ea475abc03d02def7e9a27 P 722df47a60ca4bfa82104dea57718f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:03.882513 3729 ts_tablet_manager.cc:1434] T 48c932d095ea475abc03d02def7e9a27 P 722df47a60ca4bfa82104dea57718f3b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260618 19:57:03.911166 3447 tablet_service.cc:1511] Processing CreateTablet for tablet c541a856079f40e18ef4101d82461164 (DEFAULT_TABLE table=default.table_8a3fffa237bc419e8921a2b75f70e639 [id=c256b56cd126492ea4f98f7d075e0a53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:03.911504 3307 tablet_service.cc:1511] Processing CreateTablet for tablet c541a856079f40e18ef4101d82461164 (DEFAULT_TABLE table=default.table_8a3fffa237bc419e8921a2b75f70e639 [id=c256b56cd126492ea4f98f7d075e0a53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:03.911679 3447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c541a856079f40e18ef4101d82461164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:03.911927 3307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c541a856079f40e18ef4101d82461164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:03.918335 3729 tablet_bootstrap.cc:492] T c541a856079f40e18ef4101d82461164 P 722df47a60ca4bfa82104dea57718f3b: Bootstrap starting.
I20260618 19:57:03.920523 3729 tablet_bootstrap.cc:654] T c541a856079f40e18ef4101d82461164 P 722df47a60ca4bfa82104dea57718f3b: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:03.930559 3732 tablet_bootstrap.cc:492] T c541a856079f40e18ef4101d82461164 P 51c7777f264b496a9bf9511966dcfbd7: Bootstrap starting.
I20260618 19:57:03.932387 3732 tablet_bootstrap.cc:654] T c541a856079f40e18ef4101d82461164 P 51c7777f264b496a9bf9511966dcfbd7: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:03.932228 2993 catalog_manager.cc:5696] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131). New cstate: current_term: 1 leader_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } health_report { overall_health: UNKNOWN } } }
I20260618 19:57:03.941035 3729 tablet_bootstrap.cc:492] T c541a856079f40e18ef4101d82461164 P 722df47a60ca4bfa82104dea57718f3b: No bootstrap required, opened a new log
I20260618 19:57:03.941242 3729 ts_tablet_manager.cc:1403] T c541a856079f40e18ef4101d82461164 P 722df47a60ca4bfa82104dea57718f3b: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.006s
I20260618 19:57:03.942152 3729 raft_consensus.cc:359] T c541a856079f40e18ef4101d82461164 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } }
I20260618 19:57:03.942363 3729 raft_consensus.cc:385] T c541a856079f40e18ef4101d82461164 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:03.942461 3729 raft_consensus.cc:740] T c541a856079f40e18ef4101d82461164 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 722df47a60ca4bfa82104dea57718f3b, State: Initialized, Role: FOLLOWER
I20260618 19:57:03.942711 3729 consensus_queue.cc:260] T c541a856079f40e18ef4101d82461164 P 722df47a60ca4bfa82104dea57718f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } }
I20260618 19:57:03.945899 3729 ts_tablet_manager.cc:1434] T c541a856079f40e18ef4101d82461164 P 722df47a60ca4bfa82104dea57718f3b: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260618 19:57:03.949903 3732 tablet_bootstrap.cc:492] T c541a856079f40e18ef4101d82461164 P 51c7777f264b496a9bf9511966dcfbd7: No bootstrap required, opened a new log
I20260618 19:57:03.950083 3732 ts_tablet_manager.cc:1403] T c541a856079f40e18ef4101d82461164 P 51c7777f264b496a9bf9511966dcfbd7: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.006s
I20260618 19:57:03.951079 3590 tablet_service.cc:1511] Processing CreateTablet for tablet c541a856079f40e18ef4101d82461164 (DEFAULT_TABLE table=default.table_8a3fffa237bc419e8921a2b75f70e639 [id=c256b56cd126492ea4f98f7d075e0a53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:03.951538 3590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c541a856079f40e18ef4101d82461164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:03.956707 2993 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50008:
name: "default.Table_0975ad87638142ddbb8e4438fc9393a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:03.959774 3732 raft_consensus.cc:359] T c541a856079f40e18ef4101d82461164 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } }
I20260618 19:57:03.959996 3732 raft_consensus.cc:385] T c541a856079f40e18ef4101d82461164 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:03.960098 3732 raft_consensus.cc:740] T c541a856079f40e18ef4101d82461164 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51c7777f264b496a9bf9511966dcfbd7, State: Initialized, Role: FOLLOWER
I20260618 19:57:03.960381 3732 consensus_queue.cc:260] T c541a856079f40e18ef4101d82461164 P 51c7777f264b496a9bf9511966dcfbd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } }
I20260618 19:57:03.964510 3732 ts_tablet_manager.cc:1434] T c541a856079f40e18ef4101d82461164 P 51c7777f264b496a9bf9511966dcfbd7: Time spent starting tablet: real 0.014s user 0.000s sys 0.003s
I20260618 19:57:03.970711 3730 tablet_bootstrap.cc:492] T 48c932d095ea475abc03d02def7e9a27 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: No bootstrap required, opened a new log
I20260618 19:57:03.970933 3730 ts_tablet_manager.cc:1403] T 48c932d095ea475abc03d02def7e9a27 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent bootstrapping tablet: real 0.107s user 0.029s sys 0.033s
I20260618 19:57:03.971939 3730 raft_consensus.cc:359] T 48c932d095ea475abc03d02def7e9a27 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:03.972178 3730 raft_consensus.cc:385] T 48c932d095ea475abc03d02def7e9a27 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:03.972276 3730 raft_consensus.cc:740] T 48c932d095ea475abc03d02def7e9a27 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb3ca8239f4412fb8b0e7d0df9e50c1, State: Initialized, Role: FOLLOWER
I20260618 19:57:03.972568 3730 consensus_queue.cc:260] T 48c932d095ea475abc03d02def7e9a27 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:03.980012 3730 ts_tablet_manager.cc:1434] T 48c932d095ea475abc03d02def7e9a27 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260618 19:57:03.980445 3730 tablet_bootstrap.cc:492] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Bootstrap starting.
I20260618 19:57:03.986060 3730 tablet_bootstrap.cc:654] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:03.998811 3730 tablet_bootstrap.cc:492] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: No bootstrap required, opened a new log
I20260618 19:57:03.999007 3730 ts_tablet_manager.cc:1403] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.005s
I20260618 19:57:03.999995 3730 raft_consensus.cc:359] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } }
I20260618 19:57:04.000212 3730 raft_consensus.cc:385] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:04.000317 3730 raft_consensus.cc:740] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb3ca8239f4412fb8b0e7d0df9e50c1, State: Initialized, Role: FOLLOWER
I20260618 19:57:04.000627 3730 consensus_queue.cc:260] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } }
I20260618 19:57:04.003291 3730 ts_tablet_manager.cc:1434] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260618 19:57:04.049083 3765 raft_consensus.cc:493] T 6dcdf661fe344b90bb6002d07206bd53 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:04.049357 3765 raft_consensus.cc:515] T 6dcdf661fe344b90bb6002d07206bd53 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.050361 3765 leader_election.cc:290] T 6dcdf661fe344b90bb6002d07206bd53 P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:04.051620 3327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dcdf661fe344b90bb6002d07206bd53" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7" is_pre_election: true
I20260618 19:57:04.051982 3327 raft_consensus.cc:2393] T 6dcdf661fe344b90bb6002d07206bd53 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 722df47a60ca4bfa82104dea57718f3b in current term 1: Already voted for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in this term.
I20260618 19:57:04.052556 3610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dcdf661fe344b90bb6002d07206bd53" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" is_pre_election: true
I20260618 19:57:04.053602 3402 leader_election.cc:304] T 6dcdf661fe344b90bb6002d07206bd53 P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 722df47a60ca4bfa82104dea57718f3b; no voters: 51c7777f264b496a9bf9511966dcfbd7, 6bb3ca8239f4412fb8b0e7d0df9e50c1
I20260618 19:57:04.054085 3765 raft_consensus.cc:3060] T 6dcdf661fe344b90bb6002d07206bd53 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:04.056949 3765 raft_consensus.cc:2749] T 6dcdf661fe344b90bb6002d07206bd53 P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260618 19:57:04.109164 3735 raft_consensus.cc:493] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:04.109436 3735 raft_consensus.cc:515] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } }
I20260618 19:57:04.110287 3735 leader_election.cc:290] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483)
I20260618 19:57:04.111176 3327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c541a856079f40e18ef4101d82461164" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7" is_pre_election: true
I20260618 19:57:04.111476 3327 raft_consensus.cc:2468] T c541a856079f40e18ef4101d82461164 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 0.
I20260618 19:57:04.112200 3546 leader_election.cc:304] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7, 6bb3ca8239f4412fb8b0e7d0df9e50c1; no voters:
I20260618 19:57:04.112309 3467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c541a856079f40e18ef4101d82461164" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "722df47a60ca4bfa82104dea57718f3b" is_pre_election: true
I20260618 19:57:04.112519 3735 raft_consensus.cc:2804] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 19:57:04.112573 3467 raft_consensus.cc:2468] T c541a856079f40e18ef4101d82461164 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 0.
I20260618 19:57:04.112661 3735 raft_consensus.cc:493] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 19:57:04.112763 3735 raft_consensus.cc:3060] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:04.115937 3735 raft_consensus.cc:515] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } }
I20260618 19:57:04.117168 3327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c541a856079f40e18ef4101d82461164" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7"
I20260618 19:57:04.117426 3327 raft_consensus.cc:3060] T c541a856079f40e18ef4101d82461164 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:04.120589 3327 raft_consensus.cc:2468] T c541a856079f40e18ef4101d82461164 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 1.
I20260618 19:57:04.121137 3546 leader_election.cc:304] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7, 6bb3ca8239f4412fb8b0e7d0df9e50c1; no voters:
I20260618 19:57:04.121568 3760 raft_consensus.cc:2804] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 19:57:04.121743 3760 raft_consensus.cc:697] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 LEADER]: Becoming Leader. State: Replica: 6bb3ca8239f4412fb8b0e7d0df9e50c1, State: Running, Role: LEADER
I20260618 19:57:04.121793 3735 leader_election.cc:290] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 election: Requested vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483)
I20260618 19:57:04.122107 3760 consensus_queue.cc:237] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } }
I20260618 19:57:04.123921 3467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c541a856079f40e18ef4101d82461164" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "722df47a60ca4bfa82104dea57718f3b"
I20260618 19:57:04.124186 3467 raft_consensus.cc:3060] T c541a856079f40e18ef4101d82461164 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:04.126973 3467 raft_consensus.cc:2468] T c541a856079f40e18ef4101d82461164 P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 1.
19:57:04.194 [HMS - ERROR - pool-6-thread-2] (RetryingHMSHandler.java:201) AlreadyExistsException(message:Table hive.default.table_402627eeff7b4c338e64cfbe575411be already exists)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:1839)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:1786)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_with_environment_context(HiveMetaStore.java:2035)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:569)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108)
at jdk.proxy2/jdk.proxy2.$Proxy27.create_table_with_environment_context(Unknown Source)
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:14800)
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:14784)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:104)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:840)
W20260618 19:57:04.197460 2992 catalog_manager.cc:2195] Already present: failed to create HMS catalog entry for table [id=2f6fcabeaca246a6abdc0031969560db]: failed to create Hive MetaStore table: TException - service has thrown: AlreadyExistsException(message=Table hive.default.table_402627eeff7b4c338e64cfbe575411be already exists)
I20260618 19:57:04.198019 2992 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:50008 (request call id 10) took 1323 ms. Trace:
I20260618 19:57:04.198168 2992 rpcz_store.cc:276] 0618 19:57:02.874481 (+ 0us) service_pool.cc:167] Inserting onto call queue
0618 19:57:02.880016 (+ 5535us) service_pool.cc:224] Handling call
0618 19:57:03.232365 (+352349us) catalog_manager.cc:2126] Acquired catalog manager lock
0618 19:57:03.232806 (+ 441us) catalog_manager.cc:2172] Created new table and tablet info
0618 19:57:04.197965 (+965159us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":623521,"Hive Metastore.run_cpu_time_us":1203,"Hive Metastore.run_wall_time_us":340808}
I20260618 19:57:04.211844 2992 catalog_manager.cc:5696] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131). New cstate: current_term: 1 leader_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } health_report { overall_health: UNKNOWN } } }
I20260618 19:57:04.223860 2992 master_service.cc:960] ReplaceTablet: received request to replace tablet 1e5805a1516f4adbb12c67decfa3352f from {username='slave'} at 127.0.0.1:50008
I20260618 19:57:04.230731 2992 catalog_manager.cc:5983] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1: Sending DeleteTablet for 3 replicas of tablet 1e5805a1516f4adbb12c67decfa3352f
I20260618 19:57:04.231235 2992 catalog_manager.cc:6784] ReplaceTablet: tablet 1e5805a1516f4adbb12c67decfa3352f deleted and replaced by tablet f45d6e214bb646cdbf84ee1572859863
I20260618 19:57:04.231444 2992 master_service.cc:960] ReplaceTablet: received request to replace tablet 9b509a2b95f6457d90f68990d272b8fc from {username='slave'} at 127.0.0.1:50008
I20260618 19:57:04.237162 3447 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e5805a1516f4adbb12c67decfa3352f with delete_type TABLET_DATA_DELETED (replaced by tablet f45d6e214bb646cdbf84ee1572859863) from {username='slave'} at 127.0.0.1:36324
I20260618 19:57:04.237603 3590 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e5805a1516f4adbb12c67decfa3352f with delete_type TABLET_DATA_DELETED (replaced by tablet f45d6e214bb646cdbf84ee1572859863) from {username='slave'} at 127.0.0.1:44288
I20260618 19:57:04.239130 3307 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e5805a1516f4adbb12c67decfa3352f with delete_type TABLET_DATA_DELETED (replaced by tablet f45d6e214bb646cdbf84ee1572859863) from {username='slave'} at 127.0.0.1:39210
I20260618 19:57:04.245718 3776 tablet_replica.cc:333] T 1e5805a1516f4adbb12c67decfa3352f P 6bb3ca8239f4412fb8b0e7d0df9e50c1: stopping tablet replica
I20260618 19:57:04.245960 3776 raft_consensus.cc:2243] T 1e5805a1516f4adbb12c67decfa3352f P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 19:57:04.246176 3776 raft_consensus.cc:2272] T 1e5805a1516f4adbb12c67decfa3352f P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:04.246740 3776 ts_tablet_manager.cc:1916] T 1e5805a1516f4adbb12c67decfa3352f P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:04.249099 3775 tablet_replica.cc:333] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b: stopping tablet replica
I20260618 19:57:04.249334 3775 raft_consensus.cc:2243] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b [term 1 LEADER]: Raft consensus shutting down.
I20260618 19:57:04.249635 3590 tablet_service.cc:1511] Processing CreateTablet for tablet f45d6e214bb646cdbf84ee1572859863 (DEFAULT_TABLE table=default.table_4f9cd241b4284c4796f2aba3ccec0e35 [id=873b29232cab4ad9a9f8c070455c98a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:04.249898 3775 pending_rounds.cc:70] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b: Trying to abort 1 pending ops.
I20260618 19:57:04.250068 3590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f45d6e214bb646cdbf84ee1572859863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:04.250145 2992 catalog_manager.cc:5983] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1: Sending DeleteTablet for 3 replicas of tablet 9b509a2b95f6457d90f68990d272b8fc
I20260618 19:57:04.250169 3777 tablet_replica.cc:333] T 1e5805a1516f4adbb12c67decfa3352f P 51c7777f264b496a9bf9511966dcfbd7: stopping tablet replica
I20260618 19:57:04.250099 3775 pending_rounds.cc:77] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298304507188789248 op_type: NO_OP noop_request { }
I20260618 19:57:04.250295 3775 raft_consensus.cc:2889] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260618 19:57:04.250375 3777 raft_consensus.cc:2243] T 1e5805a1516f4adbb12c67decfa3352f P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 19:57:04.250419 3775 raft_consensus.cc:2272] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:04.250564 3777 raft_consensus.cc:2272] T 1e5805a1516f4adbb12c67decfa3352f P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:04.250660 2992 catalog_manager.cc:6784] ReplaceTablet: tablet 9b509a2b95f6457d90f68990d272b8fc deleted and replaced by tablet dda398a6683d49c58c7f1ca63a06a8b6
I20260618 19:57:04.250882 2992 master_service.cc:960] ReplaceTablet: received request to replace tablet 6dcdf661fe344b90bb6002d07206bd53 from {username='slave'} at 127.0.0.1:50008
I20260618 19:57:04.251091 3777 ts_tablet_manager.cc:1916] T 1e5805a1516f4adbb12c67decfa3352f P 51c7777f264b496a9bf9511966dcfbd7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:04.251439 3775 ts_tablet_manager.cc:1916] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:04.252377 3446 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b509a2b95f6457d90f68990d272b8fc with delete_type TABLET_DATA_DELETED (replaced by tablet dda398a6683d49c58c7f1ca63a06a8b6) from {username='slave'} at 127.0.0.1:36324
I20260618 19:57:04.252843 3589 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b509a2b95f6457d90f68990d272b8fc with delete_type TABLET_DATA_DELETED (replaced by tablet dda398a6683d49c58c7f1ca63a06a8b6) from {username='slave'} at 127.0.0.1:44288
I20260618 19:57:04.253834 3306 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b509a2b95f6457d90f68990d272b8fc with delete_type TABLET_DATA_DELETED (replaced by tablet dda398a6683d49c58c7f1ca63a06a8b6) from {username='slave'} at 127.0.0.1:39210
I20260618 19:57:04.254024 3308 tablet_service.cc:1511] Processing CreateTablet for tablet f45d6e214bb646cdbf84ee1572859863 (DEFAULT_TABLE table=default.table_4f9cd241b4284c4796f2aba3ccec0e35 [id=873b29232cab4ad9a9f8c070455c98a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:04.254401 3308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f45d6e214bb646cdbf84ee1572859863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:04.257766 3775 ts_tablet_manager.cc:1929] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:04.257961 3775 log.cc:1199] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-1/wal/wals/1e5805a1516f4adbb12c67decfa3352f
I20260618 19:57:04.258466 3775 ts_tablet_manager.cc:1950] T 1e5805a1516f4adbb12c67decfa3352f P 722df47a60ca4bfa82104dea57718f3b: Deleting consensus metadata
I20260618 19:57:04.259868 2984 catalog_manager.cc:5027] TS 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483): tablet 1e5805a1516f4adbb12c67decfa3352f (table default.table_4f9cd241b4284c4796f2aba3ccec0e35 [id=873b29232cab4ad9a9f8c070455c98a9]) successfully deleted
I20260618 19:57:04.260293 3775 tablet_replica.cc:333] T 9b509a2b95f6457d90f68990d272b8fc P 722df47a60ca4bfa82104dea57718f3b: stopping tablet replica
I20260618 19:57:04.260531 3775 raft_consensus.cc:2243] T 9b509a2b95f6457d90f68990d272b8fc P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 19:57:04.260797 3775 raft_consensus.cc:2272] T 9b509a2b95f6457d90f68990d272b8fc P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:04.261404 3775 ts_tablet_manager.cc:1916] T 9b509a2b95f6457d90f68990d272b8fc P 722df47a60ca4bfa82104dea57718f3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:04.261545 3447 tablet_service.cc:1511] Processing CreateTablet for tablet f45d6e214bb646cdbf84ee1572859863 (DEFAULT_TABLE table=default.table_4f9cd241b4284c4796f2aba3ccec0e35 [id=873b29232cab4ad9a9f8c070455c98a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:04.262012 3447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f45d6e214bb646cdbf84ee1572859863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:04.266458 2991 catalog_manager.cc:2199] created HMS catalog entry for table [id=aca591adc1fb402ca2dcd58765479d54]
I20260618 19:57:04.268389 3729 tablet_bootstrap.cc:492] T f45d6e214bb646cdbf84ee1572859863 P 722df47a60ca4bfa82104dea57718f3b: Bootstrap starting.
I20260618 19:57:04.270586 3729 tablet_bootstrap.cc:654] T f45d6e214bb646cdbf84ee1572859863 P 722df47a60ca4bfa82104dea57718f3b: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:04.281597 3729 tablet_bootstrap.cc:492] T f45d6e214bb646cdbf84ee1572859863 P 722df47a60ca4bfa82104dea57718f3b: No bootstrap required, opened a new log
I20260618 19:57:04.281796 3729 ts_tablet_manager.cc:1403] T f45d6e214bb646cdbf84ee1572859863 P 722df47a60ca4bfa82104dea57718f3b: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.006s
I20260618 19:57:04.282045 3730 tablet_bootstrap.cc:492] T f45d6e214bb646cdbf84ee1572859863 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Bootstrap starting.
I20260618 19:57:04.282589 3729 raft_consensus.cc:359] T f45d6e214bb646cdbf84ee1572859863 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.282827 3729 raft_consensus.cc:385] T f45d6e214bb646cdbf84ee1572859863 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:04.282930 3729 raft_consensus.cc:740] T f45d6e214bb646cdbf84ee1572859863 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 722df47a60ca4bfa82104dea57718f3b, State: Initialized, Role: FOLLOWER
I20260618 19:57:04.283200 3729 consensus_queue.cc:260] T f45d6e214bb646cdbf84ee1572859863 P 722df47a60ca4bfa82104dea57718f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.283833 3730 tablet_bootstrap.cc:654] T f45d6e214bb646cdbf84ee1572859863 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:04.286768 3729 ts_tablet_manager.cc:1434] T f45d6e214bb646cdbf84ee1572859863 P 722df47a60ca4bfa82104dea57718f3b: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260618 19:57:04.290304 3776 ts_tablet_manager.cc:1929] T 1e5805a1516f4adbb12c67decfa3352f P 6bb3ca8239f4412fb8b0e7d0df9e50c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260618 19:57:04.290446 3776 log.cc:1199] T 1e5805a1516f4adbb12c67decfa3352f P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/wal/wals/1e5805a1516f4adbb12c67decfa3352f
I20260618 19:57:04.290845 3776 ts_tablet_manager.cc:1950] T 1e5805a1516f4adbb12c67decfa3352f P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting consensus metadata
I20260618 19:57:04.291913 2984 catalog_manager.cc:5027] TS 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): tablet 1e5805a1516f4adbb12c67decfa3352f (table default.table_4f9cd241b4284c4796f2aba3ccec0e35 [id=873b29232cab4ad9a9f8c070455c98a9]) successfully deleted
I20260618 19:57:04.291940 3775 ts_tablet_manager.cc:1929] T 9b509a2b95f6457d90f68990d272b8fc P 722df47a60ca4bfa82104dea57718f3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260618 19:57:04.292114 3775 log.cc:1199] T 9b509a2b95f6457d90f68990d272b8fc P 722df47a60ca4bfa82104dea57718f3b: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-1/wal/wals/9b509a2b95f6457d90f68990d272b8fc
I20260618 19:57:04.292582 3775 ts_tablet_manager.cc:1950] T 9b509a2b95f6457d90f68990d272b8fc P 722df47a60ca4bfa82104dea57718f3b: Deleting consensus metadata
I20260618 19:57:04.293709 2984 catalog_manager.cc:5027] TS 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483): tablet 9b509a2b95f6457d90f68990d272b8fc (table default.table_e1e6b231bd514a58a66b66d04eff6e48 [id=5a73fe372e7f47b49ed9219558f0194e]) successfully deleted
I20260618 19:57:04.272869 3732 tablet_bootstrap.cc:492] T f45d6e214bb646cdbf84ee1572859863 P 51c7777f264b496a9bf9511966dcfbd7: Bootstrap starting.
I20260618 19:57:04.301506 3760 raft_consensus.cc:493] T 48c932d095ea475abc03d02def7e9a27 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:04.301759 3760 raft_consensus.cc:515] T 48c932d095ea475abc03d02def7e9a27 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:04.302647 3760 leader_election.cc:290] T 48c932d095ea475abc03d02def7e9a27 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483), 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205)
I20260618 19:57:04.303550 3467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c932d095ea475abc03d02def7e9a27" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "722df47a60ca4bfa82104dea57718f3b" is_pre_election: true
I20260618 19:57:04.303828 3467 raft_consensus.cc:2468] T 48c932d095ea475abc03d02def7e9a27 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 0.
I20260618 19:57:04.304715 3327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c932d095ea475abc03d02def7e9a27" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7" is_pre_election: true
I20260618 19:57:04.304899 3327 raft_consensus.cc:2468] T 48c932d095ea475abc03d02def7e9a27 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 0.
I20260618 19:57:04.305470 3547 leader_election.cc:304] T 48c932d095ea475abc03d02def7e9a27 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bb3ca8239f4412fb8b0e7d0df9e50c1, 722df47a60ca4bfa82104dea57718f3b; no voters:
I20260618 19:57:04.306059 3760 raft_consensus.cc:2804] T 48c932d095ea475abc03d02def7e9a27 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 19:57:04.306149 3760 raft_consensus.cc:493] T 48c932d095ea475abc03d02def7e9a27 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 19:57:04.306254 3760 raft_consensus.cc:3060] T 48c932d095ea475abc03d02def7e9a27 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:04.306382 2991 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:50008 (request call id 11) took 1431 ms. Trace:
I20260618 19:57:04.306517 2991 rpcz_store.cc:276] 0618 19:57:02.874582 (+ 0us) service_pool.cc:167] Inserting onto call queue
0618 19:57:02.880633 (+ 6051us) service_pool.cc:224] Handling call
0618 19:57:03.233423 (+352790us) catalog_manager.cc:2126] Acquired catalog manager lock
0618 19:57:03.234063 (+ 640us) catalog_manager.cc:2172] Created new table and tablet info
0618 19:57:04.266402 (+1032339us) catalog_manager.cc:2198] Created new table in HMS catalog
0618 19:57:04.306104 (+ 39702us) catalog_manager.cc:2232] Wrote table and tablets to system table
0618 19:57:04.306226 (+ 122us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0618 19:57:04.306333 (+ 107us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0618 19:57:04.267355 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0618 19:57:04.267487 (+ 132us) write_op.cc:432] Acquiring schema lock in shared mode
0618 19:57:04.267495 (+ 8us) write_op.cc:435] Acquired schema lock
0618 19:57:04.267497 (+ 2us) tablet.cc:662] Decoding operations
0618 19:57:04.267595 (+ 98us) write_op.cc:620] Acquiring the partition lock for write op
0618 19:57:04.267609 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0618 19:57:04.267615 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0618 19:57:04.267701 (+ 86us) tablet.cc:701] Row locks acquired
0618 19:57:04.267704 (+ 3us) write_op.cc:260] PREPARE: finished
0618 19:57:04.267743 (+ 39us) write_op.cc:270] Start()
0618 19:57:04.267782 (+ 39us) write_op.cc:276] Timestamp: P: 1781812624267726 usec, L: 0
0618 19:57:04.267787 (+ 5us) op_driver.cc:348] REPLICATION: starting
0618 19:57:04.284922 (+ 17135us) log.cc:844] Serialized 432 byte log entry
0618 19:57:04.285130 (+ 208us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x616000043654. stack: 00007f078316c496 00007f078316c250 00007f07821973ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f078f1e7f22 00007f07905c9305 00007f07905c7e29 00007f07905d0250 00007f07905d005d 0000000000aa681c 00007f07831b29ff 00007f07831b5d1b 00007f07831b5b98 0000000000aa681c
0618 19:57:04.305179 (+ 20049us) op_driver.cc:464] REPLICATION: finished
0618 19:57:04.305337 (+ 158us) write_op.cc:301] APPLY: starting
0618 19:57:04.305354 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0618 19:57:04.305402 (+ 48us) tablet.cc:1370] finished BulkCheckPresence
0618 19:57:04.305407 (+ 5us) tablet.cc:1372] starting ApplyRowOperation cycle
0618 19:57:04.305607 (+ 200us) tablet.cc:1383] finished ApplyRowOperation cycle
0618 19:57:04.305657 (+ 50us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0618 19:57:04.305670 (+ 13us) write_op.cc:312] APPLY: finished
0618 19:57:04.305826 (+ 156us) log.cc:844] Serialized 28 byte log entry
0618 19:57:04.305909 (+ 83us) write_op.cc:489] Releasing partition, row and schema locks
0618 19:57:04.305931 (+ 22us) write_op.cc:454] Released schema lock
0618 19:57:04.305938 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0618 19:57:04.306019 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0618 19:57:04.306024 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":963077,"Hive Metastore.run_cpu_time_us":341,"Hive Metastore.run_wall_time_us":68728,"child_traces":[["op",{"apply.queue_time_us":39,"apply.run_cpu_time_us":672,"apply.run_wall_time_us":671,"num_ops":2,"prepare.queue_time_us":124,"prepare.run_cpu_time_us":1161,"prepare.run_wall_time_us":17849,"raft.queue_time_us":1513,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":321,"replication_time_us":37353,"spinlock_wait_cycles":39013632}]]}
I20260618 19:57:04.308913 3760 raft_consensus.cc:515] T 48c932d095ea475abc03d02def7e9a27 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:04.310192 3732 tablet_bootstrap.cc:654] T f45d6e214bb646cdbf84ee1572859863 P 51c7777f264b496a9bf9511966dcfbd7: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:04.312664 3467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c932d095ea475abc03d02def7e9a27" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "722df47a60ca4bfa82104dea57718f3b"
I20260618 19:57:04.312937 3467 raft_consensus.cc:3060] T 48c932d095ea475abc03d02def7e9a27 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:04.316187 3447 tablet_service.cc:1511] Processing CreateTablet for tablet dda398a6683d49c58c7f1ca63a06a8b6 (DEFAULT_TABLE table=default.table_e1e6b231bd514a58a66b66d04eff6e48 [id=5a73fe372e7f47b49ed9219558f0194e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:04.316699 3447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dda398a6683d49c58c7f1ca63a06a8b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:04.316665 3467 raft_consensus.cc:2468] T 48c932d095ea475abc03d02def7e9a27 P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 1.
I20260618 19:57:04.317386 3547 leader_election.cc:304] T 48c932d095ea475abc03d02def7e9a27 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bb3ca8239f4412fb8b0e7d0df9e50c1, 722df47a60ca4bfa82104dea57718f3b; no voters:
I20260618 19:57:04.317770 3735 raft_consensus.cc:2804] T 48c932d095ea475abc03d02def7e9a27 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 19:57:04.317896 3735 raft_consensus.cc:697] T 48c932d095ea475abc03d02def7e9a27 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 LEADER]: Becoming Leader. State: Replica: 6bb3ca8239f4412fb8b0e7d0df9e50c1, State: Running, Role: LEADER
I20260618 19:57:04.318158 3735 consensus_queue.cc:237] T 48c932d095ea475abc03d02def7e9a27 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:04.320278 2992 catalog_manager.cc:5983] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1: Sending DeleteTablet for 3 replicas of tablet 6dcdf661fe344b90bb6002d07206bd53
I20260618 19:57:04.320820 2992 catalog_manager.cc:6784] ReplaceTablet: tablet 6dcdf661fe344b90bb6002d07206bd53 deleted and replaced by tablet bce5543840af43b7b9933eb585ceeb80
I20260618 19:57:04.321054 2992 master_service.cc:960] ReplaceTablet: received request to replace tablet 1e5805a1516f4adbb12c67decfa3352f from {username='slave'} at 127.0.0.1:50008
I20260618 19:57:04.321733 3307 tablet_service.cc:1511] Processing CreateTablet for tablet dda398a6683d49c58c7f1ca63a06a8b6 (DEFAULT_TABLE table=default.table_e1e6b231bd514a58a66b66d04eff6e48 [id=5a73fe372e7f47b49ed9219558f0194e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:04.322208 3307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dda398a6683d49c58c7f1ca63a06a8b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:04.322777 3446 tablet_service.cc:1558] Processing DeleteTablet for tablet 6dcdf661fe344b90bb6002d07206bd53 with delete_type TABLET_DATA_DELETED (replaced by tablet bce5543840af43b7b9933eb585ceeb80) from {username='slave'} at 127.0.0.1:36324
I20260618 19:57:04.323632 3589 tablet_service.cc:1558] Processing DeleteTablet for tablet 6dcdf661fe344b90bb6002d07206bd53 with delete_type TABLET_DATA_DELETED (replaced by tablet bce5543840af43b7b9933eb585ceeb80) from {username='slave'} at 127.0.0.1:44288
I20260618 19:57:04.324882 3730 tablet_bootstrap.cc:492] T f45d6e214bb646cdbf84ee1572859863 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: No bootstrap required, opened a new log
I20260618 19:57:04.325102 3730 ts_tablet_manager.cc:1403] T f45d6e214bb646cdbf84ee1572859863 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent bootstrapping tablet: real 0.043s user 0.006s sys 0.003s
I20260618 19:57:04.325994 3327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c932d095ea475abc03d02def7e9a27" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7"
I20260618 19:57:04.326182 3327 raft_consensus.cc:3060] T 48c932d095ea475abc03d02def7e9a27 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:04.326311 3775 tablet_replica.cc:333] T 6dcdf661fe344b90bb6002d07206bd53 P 722df47a60ca4bfa82104dea57718f3b: stopping tablet replica
I20260618 19:57:04.326464 2992 master_service.cc:960] ReplaceTablet: received request to replace tablet 9b509a2b95f6457d90f68990d272b8fc from {username='slave'} at 127.0.0.1:50008
I20260618 19:57:04.326571 3775 raft_consensus.cc:2243] T 6dcdf661fe344b90bb6002d07206bd53 P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 19:57:04.326757 3775 raft_consensus.cc:2272] T 6dcdf661fe344b90bb6002d07206bd53 P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:04.326988 2992 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:50008:
table { table_name: "default.Table_39c8f72f53c5475bb66b72b21bd13991" } new_table_name: "default.Table_90f63258f4774ae884662efcb6a64fc3" modify_external_catalogs: true
I20260618 19:57:04.327359 3775 ts_tablet_manager.cc:1916] T 6dcdf661fe344b90bb6002d07206bd53 P 722df47a60ca4bfa82104dea57718f3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:04.328832 3327 raft_consensus.cc:2468] T 48c932d095ea475abc03d02def7e9a27 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 1.
I20260618 19:57:04.329413 3308 tablet_service.cc:1558] Processing DeleteTablet for tablet 6dcdf661fe344b90bb6002d07206bd53 with delete_type TABLET_DATA_DELETED (replaced by tablet bce5543840af43b7b9933eb585ceeb80) from {username='slave'} at 127.0.0.1:39210
I20260618 19:57:04.325652 3590 tablet_service.cc:1511] Processing CreateTablet for tablet dda398a6683d49c58c7f1ca63a06a8b6 (DEFAULT_TABLE table=default.table_e1e6b231bd514a58a66b66d04eff6e48 [id=5a73fe372e7f47b49ed9219558f0194e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:04.332617 3590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dda398a6683d49c58c7f1ca63a06a8b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:04.337477 3751 raft_consensus.cc:493] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:04.337690 3751 raft_consensus.cc:515] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.338464 3751 leader_election.cc:290] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483)
I20260618 19:57:04.339649 3327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b33f9c5c494332a5892a1a1ef9672d" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7" is_pre_election: true
I20260618 19:57:04.339912 3327 raft_consensus.cc:2468] T 59b33f9c5c494332a5892a1a1ef9672d P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 0.
I20260618 19:57:04.340313 3467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b33f9c5c494332a5892a1a1ef9672d" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "722df47a60ca4bfa82104dea57718f3b" is_pre_election: true
I20260618 19:57:04.340364 3546 leader_election.cc:304] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7, 6bb3ca8239f4412fb8b0e7d0df9e50c1; no voters:
I20260618 19:57:04.340584 3467 raft_consensus.cc:2468] T 59b33f9c5c494332a5892a1a1ef9672d P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 0.
I20260618 19:57:04.340636 3751 raft_consensus.cc:2804] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 19:57:04.340729 3751 raft_consensus.cc:493] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 19:57:04.340799 3751 raft_consensus.cc:3060] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:04.329893 3760 leader_election.cc:290] T 48c932d095ea475abc03d02def7e9a27 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 election: Requested vote from peers 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483), 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205)
I20260618 19:57:04.343469 3751 raft_consensus.cc:515] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.344035 3751 leader_election.cc:290] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 election: Requested vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483)
I20260618 19:57:04.344625 3467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b33f9c5c494332a5892a1a1ef9672d" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "722df47a60ca4bfa82104dea57718f3b"
I20260618 19:57:04.344877 3467 raft_consensus.cc:3060] T 59b33f9c5c494332a5892a1a1ef9672d P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:04.345465 3327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b33f9c5c494332a5892a1a1ef9672d" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7"
I20260618 19:57:04.345710 3327 raft_consensus.cc:3060] T 59b33f9c5c494332a5892a1a1ef9672d P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:04.346396 3775 ts_tablet_manager.cc:1929] T 6dcdf661fe344b90bb6002d07206bd53 P 722df47a60ca4bfa82104dea57718f3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260618 19:57:04.346608 3775 log.cc:1199] T 6dcdf661fe344b90bb6002d07206bd53 P 722df47a60ca4bfa82104dea57718f3b: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-1/wal/wals/6dcdf661fe344b90bb6002d07206bd53
I20260618 19:57:04.346907 3729 tablet_bootstrap.cc:492] T dda398a6683d49c58c7f1ca63a06a8b6 P 722df47a60ca4bfa82104dea57718f3b: Bootstrap starting.
I20260618 19:57:04.348893 3327 raft_consensus.cc:2468] T 59b33f9c5c494332a5892a1a1ef9672d P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 1.
I20260618 19:57:04.349013 3729 tablet_bootstrap.cc:654] T dda398a6683d49c58c7f1ca63a06a8b6 P 722df47a60ca4bfa82104dea57718f3b: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:04.349476 3546 leader_election.cc:304] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7, 6bb3ca8239f4412fb8b0e7d0df9e50c1; no voters:
I20260618 19:57:04.349800 3751 raft_consensus.cc:2804] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 19:57:04.349923 3751 raft_consensus.cc:697] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 LEADER]: Becoming Leader. State: Replica: 6bb3ca8239f4412fb8b0e7d0df9e50c1, State: Running, Role: LEADER
I20260618 19:57:04.350198 3751 consensus_queue.cc:237] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.352370 3730 raft_consensus.cc:359] T f45d6e214bb646cdbf84ee1572859863 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.352583 3730 raft_consensus.cc:385] T f45d6e214bb646cdbf84ee1572859863 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:04.352664 3730 raft_consensus.cc:740] T f45d6e214bb646cdbf84ee1572859863 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb3ca8239f4412fb8b0e7d0df9e50c1, State: Initialized, Role: FOLLOWER
I20260618 19:57:04.352887 3446 tablet_service.cc:1511] Processing CreateTablet for tablet bce5543840af43b7b9933eb585ceeb80 (DEFAULT_TABLE table=default.table_b11e5cb8e5194655b89a8452d2eb25f5 [id=b3a217a305294496bd2ad3d3eed4e179]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:04.352885 3730 consensus_queue.cc:260] T f45d6e214bb646cdbf84ee1572859863 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.353377 3446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bce5543840af43b7b9933eb585ceeb80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:04.352481 3775 ts_tablet_manager.cc:1950] T 6dcdf661fe344b90bb6002d07206bd53 P 722df47a60ca4bfa82104dea57718f3b: Deleting consensus metadata
I20260618 19:57:04.353426 3447 tablet_service.cc:1511] Processing CreateTablet for tablet b625d21d7f4c4cfeb54de7d636c4a64e (DEFAULT_TABLE table=default.table_77c95317631d4b1eab1943139e888ecb [id=aca591adc1fb402ca2dcd58765479d54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:04.355008 3447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b625d21d7f4c4cfeb54de7d636c4a64e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:04.358189 2984 catalog_manager.cc:5027] TS 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483): tablet 6dcdf661fe344b90bb6002d07206bd53 (table default.table_b11e5cb8e5194655b89a8452d2eb25f5 [id=b3a217a305294496bd2ad3d3eed4e179]) successfully deleted
I20260618 19:57:04.361689 3308 tablet_service.cc:1511] Processing CreateTablet for tablet bce5543840af43b7b9933eb585ceeb80 (DEFAULT_TABLE table=default.table_b11e5cb8e5194655b89a8452d2eb25f5 [id=b3a217a305294496bd2ad3d3eed4e179]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:04.362066 3730 ts_tablet_manager.cc:1434] T f45d6e214bb646cdbf84ee1572859863 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260618 19:57:04.362179 3308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bce5543840af43b7b9933eb585ceeb80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:04.362344 3589 tablet_service.cc:1511] Processing CreateTablet for tablet b625d21d7f4c4cfeb54de7d636c4a64e (DEFAULT_TABLE table=default.table_77c95317631d4b1eab1943139e888ecb [id=aca591adc1fb402ca2dcd58765479d54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:04.362737 3589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b625d21d7f4c4cfeb54de7d636c4a64e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:04.364699 3730 tablet_bootstrap.cc:492] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Bootstrap starting.
I20260618 19:57:04.365908 3765 raft_consensus.cc:493] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:04.366164 3765 raft_consensus.cc:515] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.366882 3765 leader_election.cc:290] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:04.367503 3328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d4e8e879f44a00bb9d84de8b3092dd" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7" is_pre_election: true
I20260618 19:57:04.367717 3328 raft_consensus.cc:2468] T 45d4e8e879f44a00bb9d84de8b3092dd P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 722df47a60ca4bfa82104dea57718f3b in term 0.
I20260618 19:57:04.368173 3402 leader_election.cc:304] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7, 722df47a60ca4bfa82104dea57718f3b; no voters:
I20260618 19:57:04.368471 3765 raft_consensus.cc:2804] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 19:57:04.368593 3765 raft_consensus.cc:493] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 19:57:04.368697 3765 raft_consensus.cc:3060] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:04.371310 3610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d4e8e879f44a00bb9d84de8b3092dd" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" is_pre_election: true
I20260618 19:57:04.371505 3610 raft_consensus.cc:2468] T 45d4e8e879f44a00bb9d84de8b3092dd P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 722df47a60ca4bfa82104dea57718f3b in term 0.
I20260618 19:57:04.372109 3765 raft_consensus.cc:515] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.372342 2991 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50008:
name: "default.Table_917e434e2f0140148e432b0324ad9763"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:04.373415 3765 leader_election.cc:290] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 election: Requested vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:04.374033 3328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d4e8e879f44a00bb9d84de8b3092dd" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7"
I20260618 19:57:04.374228 3328 raft_consensus.cc:3060] T 45d4e8e879f44a00bb9d84de8b3092dd P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:04.376510 3590 tablet_service.cc:1511] Processing CreateTablet for tablet bce5543840af43b7b9933eb585ceeb80 (DEFAULT_TABLE table=default.table_b11e5cb8e5194655b89a8452d2eb25f5 [id=b3a217a305294496bd2ad3d3eed4e179]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:04.376987 3590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bce5543840af43b7b9933eb585ceeb80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:04.377621 3307 tablet_service.cc:1511] Processing CreateTablet for tablet b625d21d7f4c4cfeb54de7d636c4a64e (DEFAULT_TABLE table=default.table_77c95317631d4b1eab1943139e888ecb [id=aca591adc1fb402ca2dcd58765479d54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:04.377804 3328 raft_consensus.cc:2468] T 45d4e8e879f44a00bb9d84de8b3092dd P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 722df47a60ca4bfa82104dea57718f3b in term 1.
I20260618 19:57:04.378299 3307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b625d21d7f4c4cfeb54de7d636c4a64e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:04.378434 3402 leader_election.cc:304] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7, 722df47a60ca4bfa82104dea57718f3b; no voters:
I20260618 19:57:04.379474 3610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d4e8e879f44a00bb9d84de8b3092dd" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1"
I20260618 19:57:04.379741 3610 raft_consensus.cc:3060] T 45d4e8e879f44a00bb9d84de8b3092dd P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:04.380477 3765 raft_consensus.cc:2804] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Leader election won for term 1
I20260618 19:57:04.381861 3765 raft_consensus.cc:697] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b [term 1 LEADER]: Becoming Leader. State: Replica: 722df47a60ca4bfa82104dea57718f3b, State: Running, Role: LEADER
I20260618 19:57:04.382340 3765 consensus_queue.cc:237] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.382848 3610 raft_consensus.cc:2468] T 45d4e8e879f44a00bb9d84de8b3092dd P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 722df47a60ca4bfa82104dea57718f3b in term 1.
I20260618 19:57:04.257257 3777 ts_tablet_manager.cc:1929] T 1e5805a1516f4adbb12c67decfa3352f P 51c7777f264b496a9bf9511966dcfbd7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260618 19:57:04.389925 3777 log.cc:1199] T 1e5805a1516f4adbb12c67decfa3352f P 51c7777f264b496a9bf9511966dcfbd7: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-0/wal/wals/1e5805a1516f4adbb12c67decfa3352f
I20260618 19:57:04.390367 3777 ts_tablet_manager.cc:1950] T 1e5805a1516f4adbb12c67decfa3352f P 51c7777f264b496a9bf9511966dcfbd7: Deleting consensus metadata
I20260618 19:57:04.391505 2983 catalog_manager.cc:5027] TS 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205): tablet 1e5805a1516f4adbb12c67decfa3352f (table default.table_4f9cd241b4284c4796f2aba3ccec0e35 [id=873b29232cab4ad9a9f8c070455c98a9]) successfully deleted
I20260618 19:57:04.391867 3777 tablet_replica.cc:333] T 9b509a2b95f6457d90f68990d272b8fc P 51c7777f264b496a9bf9511966dcfbd7: stopping tablet replica
I20260618 19:57:04.392086 3777 raft_consensus.cc:2243] T 9b509a2b95f6457d90f68990d272b8fc P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 19:57:04.392259 3777 raft_consensus.cc:2272] T 9b509a2b95f6457d90f68990d272b8fc P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:04.392798 3777 ts_tablet_manager.cc:1916] T 9b509a2b95f6457d90f68990d272b8fc P 51c7777f264b496a9bf9511966dcfbd7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:04.396478 3467 raft_consensus.cc:2468] T 59b33f9c5c494332a5892a1a1ef9672d P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 1.
I20260618 19:57:04.398226 3776 tablet_replica.cc:333] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1: stopping tablet replica
I20260618 19:57:04.398721 3776 raft_consensus.cc:2243] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 LEADER]: Raft consensus shutting down.
I20260618 19:57:04.399407 3776 pending_rounds.cc:70] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Trying to abort 1 pending ops.
I20260618 19:57:04.399678 3776 pending_rounds.cc:77] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298304507227385856 op_type: NO_OP noop_request { }
I20260618 19:57:04.399861 3776 raft_consensus.cc:2889] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260618 19:57:04.399996 3776 raft_consensus.cc:2272] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:04.400957 3729 tablet_bootstrap.cc:492] T dda398a6683d49c58c7f1ca63a06a8b6 P 722df47a60ca4bfa82104dea57718f3b: No bootstrap required, opened a new log
I20260618 19:57:04.401127 3729 ts_tablet_manager.cc:1403] T dda398a6683d49c58c7f1ca63a06a8b6 P 722df47a60ca4bfa82104dea57718f3b: Time spent bootstrapping tablet: real 0.054s user 0.008s sys 0.001s
I20260618 19:57:04.401973 3729 raft_consensus.cc:359] T dda398a6683d49c58c7f1ca63a06a8b6 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.402170 3729 raft_consensus.cc:385] T dda398a6683d49c58c7f1ca63a06a8b6 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:04.402267 3729 raft_consensus.cc:740] T dda398a6683d49c58c7f1ca63a06a8b6 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 722df47a60ca4bfa82104dea57718f3b, State: Initialized, Role: FOLLOWER
I20260618 19:57:04.402372 3730 tablet_bootstrap.cc:654] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:04.402513 3729 consensus_queue.cc:260] T dda398a6683d49c58c7f1ca63a06a8b6 P 722df47a60ca4bfa82104dea57718f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.403877 3729 ts_tablet_manager.cc:1434] T dda398a6683d49c58c7f1ca63a06a8b6 P 722df47a60ca4bfa82104dea57718f3b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260618 19:57:04.404655 3729 tablet_bootstrap.cc:492] T bce5543840af43b7b9933eb585ceeb80 P 722df47a60ca4bfa82104dea57718f3b: Bootstrap starting.
I20260618 19:57:04.406545 3729 tablet_bootstrap.cc:654] T bce5543840af43b7b9933eb585ceeb80 P 722df47a60ca4bfa82104dea57718f3b: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:04.416580 3776 ts_tablet_manager.cc:1916] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:04.422304 3732 tablet_bootstrap.cc:492] T f45d6e214bb646cdbf84ee1572859863 P 51c7777f264b496a9bf9511966dcfbd7: No bootstrap required, opened a new log
I20260618 19:57:04.423763 3732 ts_tablet_manager.cc:1403] T f45d6e214bb646cdbf84ee1572859863 P 51c7777f264b496a9bf9511966dcfbd7: Time spent bootstrapping tablet: real 0.151s user 0.004s sys 0.008s
I20260618 19:57:04.424801 3732 raft_consensus.cc:359] T f45d6e214bb646cdbf84ee1572859863 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.425017 3732 raft_consensus.cc:385] T f45d6e214bb646cdbf84ee1572859863 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:04.425114 3732 raft_consensus.cc:740] T f45d6e214bb646cdbf84ee1572859863 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51c7777f264b496a9bf9511966dcfbd7, State: Initialized, Role: FOLLOWER
I20260618 19:57:04.425921 3732 consensus_queue.cc:260] T f45d6e214bb646cdbf84ee1572859863 P 51c7777f264b496a9bf9511966dcfbd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.429949 3732 ts_tablet_manager.cc:1434] T f45d6e214bb646cdbf84ee1572859863 P 51c7777f264b496a9bf9511966dcfbd7: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260618 19:57:04.430261 3729 tablet_bootstrap.cc:492] T bce5543840af43b7b9933eb585ceeb80 P 722df47a60ca4bfa82104dea57718f3b: No bootstrap required, opened a new log
I20260618 19:57:04.430435 3729 ts_tablet_manager.cc:1403] T bce5543840af43b7b9933eb585ceeb80 P 722df47a60ca4bfa82104dea57718f3b: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.000s
I20260618 19:57:04.431200 3729 raft_consensus.cc:359] T bce5543840af43b7b9933eb585ceeb80 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.431401 3729 raft_consensus.cc:385] T bce5543840af43b7b9933eb585ceeb80 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:04.431506 3729 raft_consensus.cc:740] T bce5543840af43b7b9933eb585ceeb80 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 722df47a60ca4bfa82104dea57718f3b, State: Initialized, Role: FOLLOWER
I20260618 19:57:04.431797 3729 consensus_queue.cc:260] T bce5543840af43b7b9933eb585ceeb80 P 722df47a60ca4bfa82104dea57718f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.432276 3729 ts_tablet_manager.cc:1434] T bce5543840af43b7b9933eb585ceeb80 P 722df47a60ca4bfa82104dea57718f3b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260618 19:57:04.432691 3730 tablet_bootstrap.cc:492] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: No bootstrap required, opened a new log
I20260618 19:57:04.432847 3730 ts_tablet_manager.cc:1403] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent bootstrapping tablet: real 0.068s user 0.004s sys 0.000s
I20260618 19:57:04.433656 3730 raft_consensus.cc:359] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.433858 3730 raft_consensus.cc:385] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:04.433955 3730 raft_consensus.cc:740] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb3ca8239f4412fb8b0e7d0df9e50c1, State: Initialized, Role: FOLLOWER
I20260618 19:57:04.434404 3729 tablet_bootstrap.cc:492] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b: Bootstrap starting.
I20260618 19:57:04.436327 3729 tablet_bootstrap.cc:654] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:04.440284 3730 consensus_queue.cc:260] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.440591 3776 ts_tablet_manager.cc:1929] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:04.440819 3730 ts_tablet_manager.cc:1434] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260618 19:57:04.442049 3730 tablet_bootstrap.cc:492] T b625d21d7f4c4cfeb54de7d636c4a64e P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Bootstrap starting.
I20260618 19:57:04.446416 3732 tablet_bootstrap.cc:492] T dda398a6683d49c58c7f1ca63a06a8b6 P 51c7777f264b496a9bf9511966dcfbd7: Bootstrap starting.
I20260618 19:57:04.448117 3732 tablet_bootstrap.cc:654] T dda398a6683d49c58c7f1ca63a06a8b6 P 51c7777f264b496a9bf9511966dcfbd7: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:04.445176 3735 consensus_queue.cc:1048] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:04.449369 3776 log.cc:1199] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/wal/wals/9b509a2b95f6457d90f68990d272b8fc
I20260618 19:57:04.449810 3776 ts_tablet_manager.cc:1950] T 9b509a2b95f6457d90f68990d272b8fc P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting consensus metadata
I20260618 19:57:04.450874 2984 catalog_manager.cc:5027] TS 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): tablet 9b509a2b95f6457d90f68990d272b8fc (table default.table_e1e6b231bd514a58a66b66d04eff6e48 [id=5a73fe372e7f47b49ed9219558f0194e]) successfully deleted
I20260618 19:57:04.458545 3729 tablet_bootstrap.cc:492] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b: No bootstrap required, opened a new log
I20260618 19:57:04.458741 3729 ts_tablet_manager.cc:1403] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.001s
I20260618 19:57:04.459661 3729 raft_consensus.cc:359] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.459888 3729 raft_consensus.cc:385] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:04.460005 3729 raft_consensus.cc:740] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 722df47a60ca4bfa82104dea57718f3b, State: Initialized, Role: FOLLOWER
I20260618 19:57:04.460326 3729 consensus_queue.cc:260] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.460875 3729 ts_tablet_manager.cc:1434] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260618 19:57:04.461423 3776 tablet_replica.cc:333] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: stopping tablet replica
I20260618 19:57:04.461707 3776 raft_consensus.cc:2243] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 LEADER]: Raft consensus shutting down.
I20260618 19:57:04.462003 3776 pending_rounds.cc:70] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Trying to abort 1 pending ops.
I20260618 19:57:04.462124 3776 pending_rounds.cc:77] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298304506300792832 op_type: NO_OP noop_request { }
I20260618 19:57:04.462179 3777 ts_tablet_manager.cc:1929] T 9b509a2b95f6457d90f68990d272b8fc P 51c7777f264b496a9bf9511966dcfbd7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260618 19:57:04.462267 3776 raft_consensus.cc:2889] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260618 19:57:04.462435 3776 raft_consensus.cc:2272] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:04.462598 3777 log.cc:1199] T 9b509a2b95f6457d90f68990d272b8fc P 51c7777f264b496a9bf9511966dcfbd7: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-0/wal/wals/9b509a2b95f6457d90f68990d272b8fc
I20260618 19:57:04.463305 3777 ts_tablet_manager.cc:1950] T 9b509a2b95f6457d90f68990d272b8fc P 51c7777f264b496a9bf9511966dcfbd7: Deleting consensus metadata
I20260618 19:57:04.464316 3777 tablet_replica.cc:333] T 6dcdf661fe344b90bb6002d07206bd53 P 51c7777f264b496a9bf9511966dcfbd7: stopping tablet replica
I20260618 19:57:04.464540 3777 raft_consensus.cc:2243] T 6dcdf661fe344b90bb6002d07206bd53 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 19:57:04.464494 2983 catalog_manager.cc:5027] TS 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205): tablet 9b509a2b95f6457d90f68990d272b8fc (table default.table_e1e6b231bd514a58a66b66d04eff6e48 [id=5a73fe372e7f47b49ed9219558f0194e]) successfully deleted
I20260618 19:57:04.464737 3777 pending_rounds.cc:70] T 6dcdf661fe344b90bb6002d07206bd53 P 51c7777f264b496a9bf9511966dcfbd7: Trying to abort 1 pending ops.
I20260618 19:57:04.465827 3777 pending_rounds.cc:77] T 6dcdf661fe344b90bb6002d07206bd53 P 51c7777f264b496a9bf9511966dcfbd7: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298304506300792832 op_type: NO_OP noop_request { }
I20260618 19:57:04.466046 3777 raft_consensus.cc:2889] T 6dcdf661fe344b90bb6002d07206bd53 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260618 19:57:04.466235 3777 raft_consensus.cc:2272] T 6dcdf661fe344b90bb6002d07206bd53 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:04.465653 3732 tablet_bootstrap.cc:492] T dda398a6683d49c58c7f1ca63a06a8b6 P 51c7777f264b496a9bf9511966dcfbd7: No bootstrap required, opened a new log
I20260618 19:57:04.466634 3732 ts_tablet_manager.cc:1403] T dda398a6683d49c58c7f1ca63a06a8b6 P 51c7777f264b496a9bf9511966dcfbd7: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.001s
I20260618 19:57:04.467504 3732 raft_consensus.cc:359] T dda398a6683d49c58c7f1ca63a06a8b6 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.467768 3732 raft_consensus.cc:385] T dda398a6683d49c58c7f1ca63a06a8b6 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:04.467937 3732 raft_consensus.cc:740] T dda398a6683d49c58c7f1ca63a06a8b6 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51c7777f264b496a9bf9511966dcfbd7, State: Initialized, Role: FOLLOWER
I20260618 19:57:04.468192 3776 ts_tablet_manager.cc:1916] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:04.468222 3732 consensus_queue.cc:260] T dda398a6683d49c58c7f1ca63a06a8b6 P 51c7777f264b496a9bf9511966dcfbd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.468483 3777 ts_tablet_manager.cc:1916] T 6dcdf661fe344b90bb6002d07206bd53 P 51c7777f264b496a9bf9511966dcfbd7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:04.468755 3732 ts_tablet_manager.cc:1434] T dda398a6683d49c58c7f1ca63a06a8b6 P 51c7777f264b496a9bf9511966dcfbd7: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260618 19:57:04.469070 3732 tablet_bootstrap.cc:492] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7: Bootstrap starting.
I20260618 19:57:04.471297 3732 tablet_bootstrap.cc:654] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:04.475618 3777 ts_tablet_manager.cc:1929] T 6dcdf661fe344b90bb6002d07206bd53 P 51c7777f264b496a9bf9511966dcfbd7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:04.475765 3777 log.cc:1199] T 6dcdf661fe344b90bb6002d07206bd53 P 51c7777f264b496a9bf9511966dcfbd7: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-0/wal/wals/6dcdf661fe344b90bb6002d07206bd53
I20260618 19:57:04.475754 3730 tablet_bootstrap.cc:654] T b625d21d7f4c4cfeb54de7d636c4a64e P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:04.476173 3777 ts_tablet_manager.cc:1950] T 6dcdf661fe344b90bb6002d07206bd53 P 51c7777f264b496a9bf9511966dcfbd7: Deleting consensus metadata
I20260618 19:57:04.477425 2983 catalog_manager.cc:5027] TS 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205): tablet 6dcdf661fe344b90bb6002d07206bd53 (table default.table_b11e5cb8e5194655b89a8452d2eb25f5 [id=b3a217a305294496bd2ad3d3eed4e179]) successfully deleted
I20260618 19:57:04.491166 3730 tablet_bootstrap.cc:492] T b625d21d7f4c4cfeb54de7d636c4a64e P 6bb3ca8239f4412fb8b0e7d0df9e50c1: No bootstrap required, opened a new log
I20260618 19:57:04.491429 3730 ts_tablet_manager.cc:1403] T b625d21d7f4c4cfeb54de7d636c4a64e P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent bootstrapping tablet: real 0.049s user 0.005s sys 0.000s
I20260618 19:57:04.501200 3730 raft_consensus.cc:359] T b625d21d7f4c4cfeb54de7d636c4a64e P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.501596 3730 raft_consensus.cc:385] T b625d21d7f4c4cfeb54de7d636c4a64e P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:04.501716 3730 raft_consensus.cc:740] T b625d21d7f4c4cfeb54de7d636c4a64e P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb3ca8239f4412fb8b0e7d0df9e50c1, State: Initialized, Role: FOLLOWER
I20260618 19:57:04.502071 3730 consensus_queue.cc:260] T b625d21d7f4c4cfeb54de7d636c4a64e P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.502665 3730 ts_tablet_manager.cc:1434] T b625d21d7f4c4cfeb54de7d636c4a64e P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20260618 19:57:04.503050 3730 tablet_bootstrap.cc:492] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Bootstrap starting.
I20260618 19:57:04.504802 3730 tablet_bootstrap.cc:654] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:04.509907 3776 ts_tablet_manager.cc:1929] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:04.510113 3776 log.cc:1199] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/wal/wals/6dcdf661fe344b90bb6002d07206bd53
I20260618 19:57:04.510617 3776 ts_tablet_manager.cc:1950] T 6dcdf661fe344b90bb6002d07206bd53 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting consensus metadata
I20260618 19:57:04.510792 3732 tablet_bootstrap.cc:492] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7: No bootstrap required, opened a new log
I20260618 19:57:04.510989 3732 ts_tablet_manager.cc:1403] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7: Time spent bootstrapping tablet: real 0.042s user 0.010s sys 0.005s
I20260618 19:57:04.511853 3732 raft_consensus.cc:359] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.512118 3732 raft_consensus.cc:385] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:04.512128 2984 catalog_manager.cc:5027] TS 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): tablet 6dcdf661fe344b90bb6002d07206bd53 (table default.table_b11e5cb8e5194655b89a8452d2eb25f5 [id=b3a217a305294496bd2ad3d3eed4e179]) successfully deleted
I20260618 19:57:04.512212 3732 raft_consensus.cc:740] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51c7777f264b496a9bf9511966dcfbd7, State: Initialized, Role: FOLLOWER
I20260618 19:57:04.512466 3732 consensus_queue.cc:260] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.512984 3732 ts_tablet_manager.cc:1434] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260618 19:57:04.513199 3730 tablet_bootstrap.cc:492] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: No bootstrap required, opened a new log
I20260618 19:57:04.513330 3732 tablet_bootstrap.cc:492] T b625d21d7f4c4cfeb54de7d636c4a64e P 51c7777f264b496a9bf9511966dcfbd7: Bootstrap starting.
I20260618 19:57:04.513363 3730 ts_tablet_manager.cc:1403] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20260618 19:57:04.514202 3730 raft_consensus.cc:359] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.514405 3730 raft_consensus.cc:385] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:04.514493 3730 raft_consensus.cc:740] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb3ca8239f4412fb8b0e7d0df9e50c1, State: Initialized, Role: FOLLOWER
I20260618 19:57:04.514782 3730 consensus_queue.cc:260] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.515067 3732 tablet_bootstrap.cc:654] T b625d21d7f4c4cfeb54de7d636c4a64e P 51c7777f264b496a9bf9511966dcfbd7: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:04.515604 3730 ts_tablet_manager.cc:1434] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260618 19:57:04.529386 3732 tablet_bootstrap.cc:492] T b625d21d7f4c4cfeb54de7d636c4a64e P 51c7777f264b496a9bf9511966dcfbd7: No bootstrap required, opened a new log
I20260618 19:57:04.529489 3765 raft_consensus.cc:493] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:04.529729 3732 ts_tablet_manager.cc:1403] T b625d21d7f4c4cfeb54de7d636c4a64e P 51c7777f264b496a9bf9511966dcfbd7: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.004s
I20260618 19:57:04.529677 3765 raft_consensus.cc:515] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.530431 3765 leader_election.cc:290] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:04.531039 3610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b625d21d7f4c4cfeb54de7d636c4a64e" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" is_pre_election: true
I20260618 19:57:04.530974 3732 raft_consensus.cc:359] T b625d21d7f4c4cfeb54de7d636c4a64e P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.531286 3610 raft_consensus.cc:2468] T b625d21d7f4c4cfeb54de7d636c4a64e P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 722df47a60ca4bfa82104dea57718f3b in term 0.
I20260618 19:57:04.531118 3327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b625d21d7f4c4cfeb54de7d636c4a64e" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7" is_pre_election: true
I20260618 19:57:04.531450 3732 raft_consensus.cc:385] T b625d21d7f4c4cfeb54de7d636c4a64e P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:04.531634 3732 raft_consensus.cc:740] T b625d21d7f4c4cfeb54de7d636c4a64e P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51c7777f264b496a9bf9511966dcfbd7, State: Initialized, Role: FOLLOWER
I20260618 19:57:04.531693 3403 leader_election.cc:304] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bb3ca8239f4412fb8b0e7d0df9e50c1, 722df47a60ca4bfa82104dea57718f3b; no voters:
I20260618 19:57:04.532037 3765 raft_consensus.cc:2804] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 19:57:04.531980 3732 consensus_queue.cc:260] T b625d21d7f4c4cfeb54de7d636c4a64e P 51c7777f264b496a9bf9511966dcfbd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.532150 3765 raft_consensus.cc:493] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 19:57:04.532238 3765 raft_consensus.cc:3060] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:04.532253 3327 raft_consensus.cc:2468] T b625d21d7f4c4cfeb54de7d636c4a64e P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 722df47a60ca4bfa82104dea57718f3b in term 0.
I20260618 19:57:04.534925 3765 raft_consensus.cc:515] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.535948 3327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b625d21d7f4c4cfeb54de7d636c4a64e" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7"
I20260618 19:57:04.536144 3327 raft_consensus.cc:3060] T b625d21d7f4c4cfeb54de7d636c4a64e P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:04.536473 3765 leader_election.cc:290] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 election: Requested vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:04.536770 3610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b625d21d7f4c4cfeb54de7d636c4a64e" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1"
I20260618 19:57:04.536988 3610 raft_consensus.cc:3060] T b625d21d7f4c4cfeb54de7d636c4a64e P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:04.536011 3732 ts_tablet_manager.cc:1434] T b625d21d7f4c4cfeb54de7d636c4a64e P 51c7777f264b496a9bf9511966dcfbd7: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260618 19:57:04.539032 3327 raft_consensus.cc:2468] T b625d21d7f4c4cfeb54de7d636c4a64e P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 722df47a60ca4bfa82104dea57718f3b in term 1.
I20260618 19:57:04.539508 3402 leader_election.cc:304] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7, 722df47a60ca4bfa82104dea57718f3b; no voters:
I20260618 19:57:04.539708 3610 raft_consensus.cc:2468] T b625d21d7f4c4cfeb54de7d636c4a64e P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 722df47a60ca4bfa82104dea57718f3b in term 1.
I20260618 19:57:04.539980 3765 raft_consensus.cc:2804] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Leader election won for term 1
I20260618 19:57:04.540149 3765 raft_consensus.cc:697] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b [term 1 LEADER]: Becoming Leader. State: Replica: 722df47a60ca4bfa82104dea57718f3b, State: Running, Role: LEADER
I20260618 19:57:04.540412 3765 consensus_queue.cc:237] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.557232 2990 catalog_manager.cc:2199] created HMS catalog entry for table [id=e0eb4bb31ccb4cb58174534059e2ce81]
I20260618 19:57:04.563925 2990 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:50008 (request call id 12) took 1689 ms. Trace:
I20260618 19:57:04.564069 2990 rpcz_store.cc:276] 0618 19:57:02.874695 (+ 0us) service_pool.cc:167] Inserting onto call queue
0618 19:57:02.881100 (+ 6405us) service_pool.cc:224] Handling call
0618 19:57:03.234819 (+353719us) catalog_manager.cc:2126] Acquired catalog manager lock
0618 19:57:03.235473 (+ 654us) catalog_manager.cc:2172] Created new table and tablet info
0618 19:57:04.557181 (+1321708us) catalog_manager.cc:2198] Created new table in HMS catalog
0618 19:57:04.563660 (+ 6479us) catalog_manager.cc:2232] Wrote table and tablets to system table
0618 19:57:04.563769 (+ 109us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0618 19:57:04.563875 (+ 106us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0618 19:57:04.558002 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0618 19:57:04.558124 (+ 122us) write_op.cc:432] Acquiring schema lock in shared mode
0618 19:57:04.558131 (+ 7us) write_op.cc:435] Acquired schema lock
0618 19:57:04.558134 (+ 3us) tablet.cc:662] Decoding operations
0618 19:57:04.558221 (+ 87us) write_op.cc:620] Acquiring the partition lock for write op
0618 19:57:04.558236 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0618 19:57:04.558242 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0618 19:57:04.558326 (+ 84us) tablet.cc:701] Row locks acquired
0618 19:57:04.558328 (+ 2us) write_op.cc:260] PREPARE: finished
0618 19:57:04.558363 (+ 35us) write_op.cc:270] Start()
0618 19:57:04.558396 (+ 33us) write_op.cc:276] Timestamp: P: 1781812624558347 usec, L: 0
0618 19:57:04.558400 (+ 4us) op_driver.cc:348] REPLICATION: starting
0618 19:57:04.558630 (+ 230us) log.cc:844] Serialized 432 byte log entry
0618 19:57:04.562519 (+ 3889us) op_driver.cc:464] REPLICATION: finished
0618 19:57:04.562635 (+ 116us) write_op.cc:301] APPLY: starting
0618 19:57:04.562651 (+ 16us) tablet.cc:1367] starting BulkCheckPresence
0618 19:57:04.562697 (+ 46us) tablet.cc:1370] finished BulkCheckPresence
0618 19:57:04.562729 (+ 32us) tablet.cc:1372] starting ApplyRowOperation cycle
0618 19:57:04.562824 (+ 95us) tablet.cc:1383] finished ApplyRowOperation cycle
0618 19:57:04.562856 (+ 32us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0618 19:57:04.562863 (+ 7us) write_op.cc:312] APPLY: finished
0618 19:57:04.562936 (+ 73us) log.cc:844] Serialized 28 byte log entry
0618 19:57:04.562988 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0618 19:57:04.563007 (+ 19us) write_op.cc:454] Released schema lock
0618 19:57:04.563014 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0618 19:57:04.563075 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0618 19:57:04.563079 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1030480,"Hive Metastore.run_cpu_time_us":312,"Hive Metastore.run_wall_time_us":290830,"child_traces":[["op",{"apply.queue_time_us":74,"apply.run_cpu_time_us":432,"apply.run_wall_time_us":431,"num_ops":2,"prepare.queue_time_us":54,"prepare.run_cpu_time_us":739,"prepare.run_wall_time_us":739,"raft.queue_time_us":836,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":270,"replication_time_us":4081}]]}
F20260618 19:57:04.574249 3212 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 1, previous 1; dumping first 2 out of 10 received events: NotificationEvent(eventId=1, eventTime=1781812622, eventType=CREATE_TABLE, dbName=default, tableName=table_402627eeff7b4c338e64cfbe575411be, message={"server":"","servicePrincipal":"","db":"default","table":"table_402627eeff7b4c338e64cfbe575411be","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_402627eeff7b4c338e64cfbe575411be\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1781812622},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/warehouse/table_402627eeff7b4c338e64cfbe575411be\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_402627eeff7b4c338e64cfbe575411be\",\"kudu.table_id\":\"d0b8f5d092934582ab6ebf43cd6f9f6f\",\"transient_lastDdlTime\":\"1781812622\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"2cd457c38b944bab8903c2f58018327f\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1781812622,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=1, eventTime=1781812622, eventType=CREATE_TABLE, dbName=default, tableName=table_4957212a0ca5452e98630b441906262f, message={"server":"","servicePrincipal":"","db":"default","table":"table_4957212a0ca5452e98630b441906262f","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_4957212a0ca5452e98630b441906262f\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1781812622},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/warehouse/table_4957212a0ca5452e98630b441906262f\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_4957212a0ca5452e98630b441906262f\",\"kudu.table_id\":\"749b241f59b34125a9ff8d7c847ddd3d\",\"transient_lastDdlTime\":\"1781812622\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"2cd457c38b944bab8903c2f58018327f\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1781812622,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7f078046adcd google::LogMessage::Fail() at ??:0
I20260618 19:57:04.578845 3447 tablet_service.cc:1511] Processing CreateTablet for tablet 99a740f6744048c98e87c484ee2b492b (DEFAULT_TABLE table=default.table_736a38f9f9fe4dc7aed9092c9b7b33cb [id=e0eb4bb31ccb4cb58174534059e2ce81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:04.579028 3590 tablet_service.cc:1511] Processing CreateTablet for tablet 99a740f6744048c98e87c484ee2b492b (DEFAULT_TABLE table=default.table_736a38f9f9fe4dc7aed9092c9b7b33cb [id=e0eb4bb31ccb4cb58174534059e2ce81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:04.579334 3447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99a740f6744048c98e87c484ee2b492b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:04.579391 3590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99a740f6744048c98e87c484ee2b492b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:04.582211 2990 catalog_manager.cc:5696] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 722df47a60ca4bfa82104dea57718f3b (127.2.158.130). New cstate: current_term: 1 leader_uuid: "722df47a60ca4bfa82104dea57718f3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } health_report { overall_health: UNKNOWN } } }
I20260618 19:57:04.582440 3307 tablet_service.cc:1511] Processing CreateTablet for tablet 99a740f6744048c98e87c484ee2b492b (DEFAULT_TABLE table=default.table_736a38f9f9fe4dc7aed9092c9b7b33cb [id=e0eb4bb31ccb4cb58174534059e2ce81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:04.583298 3307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99a740f6744048c98e87c484ee2b492b. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f078046eb93 google::LogMessage::SendToLog() at ??:0
@ 0x7f078046a7cc google::LogMessage::Flush() at ??:0
@ 0x7f078046aa11 google::LogMessage::~LogMessage() at ??:0
I20260618 19:57:04.591964 3732 tablet_bootstrap.cc:492] T 99a740f6744048c98e87c484ee2b492b P 51c7777f264b496a9bf9511966dcfbd7: Bootstrap starting.
I20260618 19:57:04.593919 3732 tablet_bootstrap.cc:654] T 99a740f6744048c98e87c484ee2b492b P 51c7777f264b496a9bf9511966dcfbd7: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:04.594035 3729 tablet_bootstrap.cc:492] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b: Bootstrap starting.
I20260618 19:57:04.595813 3765 raft_consensus.cc:493] T f45d6e214bb646cdbf84ee1572859863 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:04.596026 3765 raft_consensus.cc:515] T f45d6e214bb646cdbf84ee1572859863 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.596813 3765 leader_election.cc:290] T f45d6e214bb646cdbf84ee1572859863 P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:04.596021 3729 tablet_bootstrap.cc:654] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:04.597581 3327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45d6e214bb646cdbf84ee1572859863" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7" is_pre_election: true
I20260618 19:57:04.597858 3327 raft_consensus.cc:2468] T f45d6e214bb646cdbf84ee1572859863 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 722df47a60ca4bfa82104dea57718f3b in term 0.
I20260618 19:57:04.598428 3402 leader_election.cc:304] T f45d6e214bb646cdbf84ee1572859863 P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7, 722df47a60ca4bfa82104dea57718f3b; no voters:
I20260618 19:57:04.598767 3765 raft_consensus.cc:2804] T f45d6e214bb646cdbf84ee1572859863 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 19:57:04.598888 3765 raft_consensus.cc:493] T f45d6e214bb646cdbf84ee1572859863 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 19:57:04.599057 3765 raft_consensus.cc:3060] T f45d6e214bb646cdbf84ee1572859863 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:04.600876 2990 catalog_manager.cc:5696] T 48c932d095ea475abc03d02def7e9a27 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131). New cstate: current_term: 1 leader_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } health_report { overall_health: UNKNOWN } } }
@ 0x7f0797065394 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260618 19:57:04.602052 3765 raft_consensus.cc:515] T f45d6e214bb646cdbf84ee1572859863 P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.603322 3327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45d6e214bb646cdbf84ee1572859863" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7"
I20260618 19:57:04.603550 3327 raft_consensus.cc:3060] T f45d6e214bb646cdbf84ee1572859863 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:04.603721 3610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45d6e214bb646cdbf84ee1572859863" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" is_pre_election: true
I20260618 19:57:04.603963 3610 raft_consensus.cc:2468] T f45d6e214bb646cdbf84ee1572859863 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 722df47a60ca4bfa82104dea57718f3b in term 0.
I20260618 19:57:04.606592 3327 raft_consensus.cc:2468] T f45d6e214bb646cdbf84ee1572859863 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 722df47a60ca4bfa82104dea57718f3b in term 1.
I20260618 19:57:04.607044 3402 leader_election.cc:304] T f45d6e214bb646cdbf84ee1572859863 P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7, 722df47a60ca4bfa82104dea57718f3b; no voters:
I20260618 19:57:04.607344 3736 raft_consensus.cc:2804] T f45d6e214bb646cdbf84ee1572859863 P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Leader election won for term 1
I20260618 19:57:04.609766 3765 leader_election.cc:290] T f45d6e214bb646cdbf84ee1572859863 P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 election: Requested vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:04.610505 3610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45d6e214bb646cdbf84ee1572859863" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1"
I20260618 19:57:04.610721 3610 raft_consensus.cc:3060] T f45d6e214bb646cdbf84ee1572859863 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:04.615128 3610 raft_consensus.cc:2468] T f45d6e214bb646cdbf84ee1572859863 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 722df47a60ca4bfa82104dea57718f3b in term 1.
@ 0x7f0797063c41 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260618 19:57:04.626366 3730 tablet_bootstrap.cc:492] T 99a740f6744048c98e87c484ee2b492b P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Bootstrap starting.
I20260618 19:57:04.628433 3730 tablet_bootstrap.cc:654] T 99a740f6744048c98e87c484ee2b492b P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:04.632906 3729 tablet_bootstrap.cc:492] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b: No bootstrap required, opened a new log
I20260618 19:57:04.633123 3729 ts_tablet_manager.cc:1403] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b: Time spent bootstrapping tablet: real 0.039s user 0.008s sys 0.004s
I20260618 19:57:04.634084 3729 raft_consensus.cc:359] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.634289 3729 raft_consensus.cc:385] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:04.634366 3729 raft_consensus.cc:740] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 722df47a60ca4bfa82104dea57718f3b, State: Initialized, Role: FOLLOWER
I20260618 19:57:04.634686 3729 consensus_queue.cc:260] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.635336 3729 ts_tablet_manager.cc:1434] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260618 19:57:04.638546 2990 catalog_manager.cc:5696] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 722df47a60ca4bfa82104dea57718f3b (127.2.158.130). New cstate: current_term: 1 leader_uuid: "722df47a60ca4bfa82104dea57718f3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } health_report { overall_health: UNKNOWN } } }
@ 0x7f079706b8bc kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7f079706b739 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa681d std::function<>::operator()() at ??:?
I20260618 19:57:04.661926 3736 raft_consensus.cc:697] T f45d6e214bb646cdbf84ee1572859863 P 722df47a60ca4bfa82104dea57718f3b [term 1 LEADER]: Becoming Leader. State: Replica: 722df47a60ca4bfa82104dea57718f3b, State: Running, Role: LEADER
I20260618 19:57:04.662292 3736 consensus_queue.cc:237] T f45d6e214bb646cdbf84ee1572859863 P 722df47a60ca4bfa82104dea57718f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.662883 3730 tablet_bootstrap.cc:492] T 99a740f6744048c98e87c484ee2b492b P 6bb3ca8239f4412fb8b0e7d0df9e50c1: No bootstrap required, opened a new log
I20260618 19:57:04.663069 3730 ts_tablet_manager.cc:1403] T 99a740f6744048c98e87c484ee2b492b P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent bootstrapping tablet: real 0.037s user 0.010s sys 0.001s
I20260618 19:57:04.663969 3730 raft_consensus.cc:359] T 99a740f6744048c98e87c484ee2b492b P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.664182 3730 raft_consensus.cc:385] T 99a740f6744048c98e87c484ee2b492b P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:04.664258 3730 raft_consensus.cc:740] T 99a740f6744048c98e87c484ee2b492b P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb3ca8239f4412fb8b0e7d0df9e50c1, State: Initialized, Role: FOLLOWER
I20260618 19:57:04.666059 3732 tablet_bootstrap.cc:492] T 99a740f6744048c98e87c484ee2b492b P 51c7777f264b496a9bf9511966dcfbd7: No bootstrap required, opened a new log
I20260618 19:57:04.666263 3732 ts_tablet_manager.cc:1403] T 99a740f6744048c98e87c484ee2b492b P 51c7777f264b496a9bf9511966dcfbd7: Time spent bootstrapping tablet: real 0.074s user 0.010s sys 0.001s
W20260618 19:57:04.666685 2983 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111) [suppressed 13 similar messages]
I20260618 19:57:04.667085 3730 consensus_queue.cc:260] T 99a740f6744048c98e87c484ee2b492b P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.668637 3732 raft_consensus.cc:359] T 99a740f6744048c98e87c484ee2b492b P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.668851 3732 raft_consensus.cc:385] T 99a740f6744048c98e87c484ee2b492b P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:04.668933 3732 raft_consensus.cc:740] T 99a740f6744048c98e87c484ee2b492b P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51c7777f264b496a9bf9511966dcfbd7, State: Initialized, Role: FOLLOWER
I20260618 19:57:04.669032 3730 ts_tablet_manager.cc:1434] T 99a740f6744048c98e87c484ee2b492b P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20260618 19:57:04.669232 3732 consensus_queue.cc:260] T 99a740f6744048c98e87c484ee2b492b P 51c7777f264b496a9bf9511966dcfbd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.671819 3732 ts_tablet_manager.cc:1434] T 99a740f6744048c98e87c484ee2b492b P 51c7777f264b496a9bf9511966dcfbd7: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
@ 0x7f0783191f49 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f078685b6db start_thread at ??:0
@ 0x7f077f31961f clone at ??:0
W20260618 19:57:04.705489 3758 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 19:57:04.705921 3758 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 19:57:04.706046 3758 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260618 19:57:04.720458 3758 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 19:57:04.720570 3758 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260618 19:57:04.720647 3758 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 19:57:04.720707 3758 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260618 19:57:04.738327 3758 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.158.148:40109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:43379
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.158.188:34975
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.2.158.188
--webserver_port=36245
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 18 Jun 2026 19:43:24 UTC on bdcb31816ec0
build id 12458
ASAN enabled
I20260618 19:57:04.740545 3758 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 19:57:04.743050 3758 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260618 19:57:04.754554 3822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 19:57:04.754554 3821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 19:57:04.756153 3824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 19:57:04.757066 3758 server_base.cc:1061] running on GCE node
I20260618 19:57:04.757884 3758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 19:57:04.759346 3758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 19:57:04.760627 3758 hybrid_clock.cc:648] HybridClock initialized: now 1781812624760560 us; error 59 us; skew 500 ppm
I20260618 19:57:04.761044 3758 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260618 19:57:04.763638 3758 webserver.cc:533] Webserver started at http://127.2.158.188:36245/ using document root <none> and password file <none>
I20260618 19:57:04.764464 3758 fs_manager.cc:362] Metadata directory not provided
I20260618 19:57:04.764632 3758 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 19:57:04.771016 3758 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260618 19:57:04.774225 3830 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 19:57:04.775770 3758 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260618 19:57:04.776320 3735 raft_consensus.cc:493] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:04.776520 3735 raft_consensus.cc:515] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.775965 3758 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data,/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/wal
uuid: "6c13c838eb85465090e1bff0df28912f"
format_stamp: "Formatted at 2026-06-18 19:57:00 on dist-test-slave-6zlr"
I20260618 19:57:04.776976 3758 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 19:57:04.777320 3735 leader_election.cc:290] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483)
I20260618 19:57:04.778175 3467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce5543840af43b7b9933eb585ceeb80" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "722df47a60ca4bfa82104dea57718f3b" is_pre_election: true
I20260618 19:57:04.778326 3327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce5543840af43b7b9933eb585ceeb80" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7" is_pre_election: true
I20260618 19:57:04.778419 3467 raft_consensus.cc:2468] T bce5543840af43b7b9933eb585ceeb80 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 0.
I20260618 19:57:04.778584 3327 raft_consensus.cc:2468] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 0.
I20260618 19:57:04.778983 3547 leader_election.cc:304] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bb3ca8239f4412fb8b0e7d0df9e50c1, 722df47a60ca4bfa82104dea57718f3b; no voters:
I20260618 19:57:04.779397 3735 raft_consensus.cc:2804] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 19:57:04.779525 3735 raft_consensus.cc:493] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 19:57:04.779621 3735 raft_consensus.cc:3060] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:04.780560 3751 raft_consensus.cc:493] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:04.780759 3751 raft_consensus.cc:515] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.781607 3751 leader_election.cc:290] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483)
I20260618 19:57:04.782284 3327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda398a6683d49c58c7f1ca63a06a8b6" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7" is_pre_election: true
I20260618 19:57:04.782506 3327 raft_consensus.cc:2468] T dda398a6683d49c58c7f1ca63a06a8b6 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 0.
I20260618 19:57:04.782884 3735 raft_consensus.cc:515] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.782977 3546 leader_election.cc:304] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7, 6bb3ca8239f4412fb8b0e7d0df9e50c1; no voters:
I20260618 19:57:04.783337 3467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda398a6683d49c58c7f1ca63a06a8b6" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "722df47a60ca4bfa82104dea57718f3b" is_pre_election: true
I20260618 19:57:04.783586 3467 raft_consensus.cc:2468] T dda398a6683d49c58c7f1ca63a06a8b6 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 0.
I20260618 19:57:04.783938 3751 raft_consensus.cc:2804] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 19:57:04.784017 3735 leader_election.cc:290] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 election: Requested vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483)
I20260618 19:57:04.784065 3751 raft_consensus.cc:493] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 19:57:04.784214 3751 raft_consensus.cc:3060] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:04.786504 3467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce5543840af43b7b9933eb585ceeb80" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "722df47a60ca4bfa82104dea57718f3b"
I20260618 19:57:04.786603 3751 raft_consensus.cc:515] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.786758 3467 raft_consensus.cc:3060] T bce5543840af43b7b9933eb585ceeb80 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:04.787392 3751 leader_election.cc:290] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 election: Requested vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483)
I20260618 19:57:04.787708 3327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce5543840af43b7b9933eb585ceeb80" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7"
I20260618 19:57:04.787925 3327 raft_consensus.cc:3060] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:04.789880 3328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda398a6683d49c58c7f1ca63a06a8b6" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7"
I20260618 19:57:04.790084 3328 raft_consensus.cc:3060] T dda398a6683d49c58c7f1ca63a06a8b6 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:04.790819 3467 raft_consensus.cc:2468] T bce5543840af43b7b9933eb585ceeb80 P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 1.
I20260618 19:57:04.791406 3327 raft_consensus.cc:2468] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 1.
I20260618 19:57:04.791713 3547 leader_election.cc:304] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bb3ca8239f4412fb8b0e7d0df9e50c1, 722df47a60ca4bfa82104dea57718f3b; no voters:
I20260618 19:57:04.791994 3751 raft_consensus.cc:2804] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 19:57:04.792156 3751 raft_consensus.cc:697] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 LEADER]: Becoming Leader. State: Replica: 6bb3ca8239f4412fb8b0e7d0df9e50c1, State: Running, Role: LEADER
I20260618 19:57:04.792421 3751 consensus_queue.cc:237] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.792421 3467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda398a6683d49c58c7f1ca63a06a8b6" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "722df47a60ca4bfa82104dea57718f3b"
I20260618 19:57:04.792737 3467 raft_consensus.cc:3060] T dda398a6683d49c58c7f1ca63a06a8b6 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:04.793032 3328 raft_consensus.cc:2468] T dda398a6683d49c58c7f1ca63a06a8b6 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 1.
I20260618 19:57:04.793898 3546 leader_election.cc:304] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7, 6bb3ca8239f4412fb8b0e7d0df9e50c1; no voters:
I20260618 19:57:04.794287 3760 raft_consensus.cc:2804] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 19:57:04.794495 3760 raft_consensus.cc:697] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 LEADER]: Becoming Leader. State: Replica: 6bb3ca8239f4412fb8b0e7d0df9e50c1, State: Running, Role: LEADER
I20260618 19:57:04.794760 3760 consensus_queue.cc:237] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.798748 3467 raft_consensus.cc:2468] T dda398a6683d49c58c7f1ca63a06a8b6 P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 1.
I20260618 19:57:04.857450 3758 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 19:57:04.858623 3758 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 19:57:04.858940 3758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 19:57:04.885869 3883 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.158.188:34975 every 8 connection(s)
I20260618 19:57:04.885900 3758 rpc_server.cc:307] RPC server started. Bound to: 127.2.158.188:34975
I20260618 19:57:04.888808 3758 server_base.cc:1193] Dumped server information to /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data/info.pb
I20260618 19:57:04.895660 2682 external_mini_cluster.cc:1434] Started /tmp/dist-test-task_3iVrE/build/asan/bin/kudu as pid 3758
I20260618 19:57:04.896486 3884 sys_catalog.cc:263] Verifying existing consensus state
I20260618 19:57:04.900751 3884 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: Bootstrap starting.
I20260618 19:57:04.910712 3884 log.cc:826] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: Log is configured to *not* fsync() on all Append() calls
I20260618 19:57:04.921463 3884 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260618 19:57:04.922302 3884 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: Bootstrap complete.
I20260618 19:57:04.930742 3884 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 2 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:04.932199 3884 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c13c838eb85465090e1bff0df28912f, State: Initialized, Role: FOLLOWER
I20260618 19:57:04.933254 3884 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:04.934415 3751 consensus_queue.cc:1048] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:04.954054 3888 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:04.954512 3888 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: This master's current role is: FOLLOWER
I20260618 19:57:04.955502 3884 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: configured and running, proceeding with master startup.
I20260618 19:57:04.958212 3760 consensus_queue.cc:1048] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:04.964748 3736 raft_consensus.cc:493] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:04.964943 3736 raft_consensus.cc:515] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.965788 3736 leader_election.cc:290] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:04.966617 3327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a740f6744048c98e87c484ee2b492b" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7" is_pre_election: true
I20260618 19:57:04.966763 3610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a740f6744048c98e87c484ee2b492b" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" is_pre_election: true
I20260618 19:57:04.966913 3327 raft_consensus.cc:2468] T 99a740f6744048c98e87c484ee2b492b P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 722df47a60ca4bfa82104dea57718f3b in term 0.
I20260618 19:57:04.967052 3610 raft_consensus.cc:2468] T 99a740f6744048c98e87c484ee2b492b P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 722df47a60ca4bfa82104dea57718f3b in term 0.
I20260618 19:57:04.967582 3403 leader_election.cc:304] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bb3ca8239f4412fb8b0e7d0df9e50c1, 722df47a60ca4bfa82104dea57718f3b; no voters:
I20260618 19:57:04.968128 3736 raft_consensus.cc:2804] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 19:57:04.968247 3736 raft_consensus.cc:493] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 19:57:04.968339 3736 raft_consensus.cc:3060] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:04.970732 3513 heartbeater.cc:344] Connected to a master server at 127.2.158.188:34975
I20260618 19:57:04.970925 3513 heartbeater.cc:499] Master 127.2.158.188:34975 was elected leader, sending a full tablet report...
I20260618 19:57:04.972815 3736 raft_consensus.cc:515] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.977531 3736 leader_election.cc:290] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 election: Requested vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:04.977296 3610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a740f6744048c98e87c484ee2b492b" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1"
I20260618 19:57:04.977880 3610 raft_consensus.cc:3060] T 99a740f6744048c98e87c484ee2b492b P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:04.981865 3610 raft_consensus.cc:2468] T 99a740f6744048c98e87c484ee2b492b P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 722df47a60ca4bfa82104dea57718f3b in term 1.
I20260618 19:57:04.982134 3327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a740f6744048c98e87c484ee2b492b" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7"
I20260618 19:57:04.982458 3327 raft_consensus.cc:3060] T 99a740f6744048c98e87c484ee2b492b P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:04.982534 3403 leader_election.cc:304] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bb3ca8239f4412fb8b0e7d0df9e50c1, 722df47a60ca4bfa82104dea57718f3b; no voters:
I20260618 19:57:04.982940 3736 raft_consensus.cc:2804] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Leader election won for term 1
I20260618 19:57:04.983167 3736 raft_consensus.cc:697] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b [term 1 LEADER]: Becoming Leader. State: Replica: 722df47a60ca4bfa82104dea57718f3b, State: Running, Role: LEADER
I20260618 19:57:04.983515 3736 consensus_queue.cc:237] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:04.986294 3513 heartbeater.cc:499] Master 127.2.158.188:34975 was elected leader, sending a full tablet report...
I20260618 19:57:04.987484 3327 raft_consensus.cc:2468] T 99a740f6744048c98e87c484ee2b492b P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 722df47a60ca4bfa82104dea57718f3b in term 1.
I20260618 19:57:04.988776 3374 heartbeater.cc:344] Connected to a master server at 127.2.158.188:34975
I20260618 19:57:04.988999 3374 heartbeater.cc:499] Master 127.2.158.188:34975 was elected leader, sending a full tablet report...
I20260618 19:57:04.992756 3657 heartbeater.cc:344] Connected to a master server at 127.2.158.188:34975
I20260618 19:57:04.992993 3657 heartbeater.cc:499] Master 127.2.158.188:34975 was elected leader, sending a full tablet report...
W20260618 19:57:04.994660 3666 connection.cc:573] client connection to 127.2.158.190:41233 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260618 19:57:04.995611 3666 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.2.158.190:41233)
W20260618 19:57:04.995972 3666 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.2.158.190:41233)
W20260618 19:57:04.996320 3666 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.2.158.190:41233)
W20260618 19:57:05.000550 3666 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.2.158.190:41233)
W20260618 19:57:05.015446 3757 negotiation.cc:336] Failed RPC negotiation. Trace:
0618 19:57:05.012289 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.2.158.190:41233 (local address 127.2.158.129:41735)
0618 19:57:05.012570 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0618 19:57:05.012609 (+ 39us) client_negotiation.cc:175] Beginning negotiation
0618 19:57:05.012733 (+ 124us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0618 19:57:05.014446 (+ 1713us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":138}
W20260618 19:57:05.016822 3899 negotiation.cc:336] Failed RPC negotiation. Trace:
0618 19:57:05.002078 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.2.158.190:41233 (local address 127.0.0.1:50022)
0618 19:57:05.016276 (+ 14198us) negotiation.cc:107] Waiting for socket to connect
0618 19:57:05.016477 (+ 201us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":14026,"threads_started":1}
W20260618 19:57:05.017510 3761 negotiation.cc:336] Failed RPC negotiation. Trace:
0618 19:57:05.012994 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.2.158.190:41233 (local address 127.2.158.130:58621)
0618 19:57:05.013619 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0618 19:57:05.013638 (+ 19us) client_negotiation.cc:175] Beginning negotiation
0618 19:57:05.013743 (+ 105us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0618 19:57:05.016598 (+ 2855us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":502}
I20260618 19:57:05.018625 3374 heartbeater.cc:499] Master 127.2.158.188:34975 was elected leader, sending a full tablet report...
I20260618 19:57:05.050580 3912 catalog_manager.cc:1294] Loaded cluster ID: 2cd457c38b944bab8903c2f58018327f
I20260618 19:57:05.050721 3912 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: loading cluster ID for follower catalog manager: success
I20260618 19:57:05.043351 3758 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:57:05.051151 3758 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260618 19:57:05.057444 3912 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: acquiring CA information for follower catalog manager: success
I20260618 19:57:05.061921 3912 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260618 19:57:05.073738 3760 consensus_queue.cc:1048] T 48c932d095ea475abc03d02def7e9a27 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:05.076269 3513 heartbeater.cc:499] Master 127.2.158.188:34975 was elected leader, sending a full tablet report...
I20260618 19:57:05.090382 3657 heartbeater.cc:499] Master 127.2.158.188:34975 was elected leader, sending a full tablet report...
I20260618 19:57:05.091176 3849 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" instance_seqno: 1781812621902304) as {username='slave'} at 127.2.158.130:54011; Asking this server to re-register.
I20260618 19:57:05.092217 3513 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:05.092482 3751 consensus_queue.cc:1048] T 48c932d095ea475abc03d02def7e9a27 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:05.093206 3848 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" instance_seqno: 1781812622463911) as {username='slave'} at 127.2.158.131:41717; Asking this server to re-register.
I20260618 19:57:05.094101 3374 heartbeater.cc:499] Master 127.2.158.188:34975 was elected leader, sending a full tablet report...
I20260618 19:57:05.094568 3847 ts_manager.cc:194] Registered new tserver with Master: 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483)
I20260618 19:57:05.096524 3657 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:05.100214 3849 ts_manager.cc:194] Registered new tserver with Master: 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:05.103551 3849 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" instance_seqno: 1781812621349212) as {username='slave'} at 127.2.158.129:46763; Asking this server to re-register.
I20260618 19:57:05.104312 3374 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:05.106052 3849 ts_manager.cc:194] Registered new tserver with Master: 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205)
I20260618 19:57:05.150812 3918 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader acc600e5aa44409ea3ce4c2861cb4de1)
I20260618 19:57:05.151073 3918 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:05.151933 3918 leader_election.cc:290] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975)
W20260618 19:57:05.156731 3051 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111) [suppressed 4 similar messages]
W20260618 19:57:05.158587 3051 leader_election.cc:336] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 19:57:05.164619 3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0447960184714aaf886ca15b9aa0e63a" candidate_term: 4 candidate_status { last_received { term: 3 index: 37 } } ignore_live_leader: false dest_uuid: "6c13c838eb85465090e1bff0df28912f" is_pre_election: true
I20260618 19:57:05.165162 3859 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0447960184714aaf886ca15b9aa0e63a in term 2.
I20260618 19:57:05.165714 3053 leader_election.cc:304] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0447960184714aaf886ca15b9aa0e63a, 6c13c838eb85465090e1bff0df28912f; no voters: acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:05.166010 3918 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260618 19:57:05.166153 3918 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 3 FOLLOWER]: Starting leader election (detected failure of leader acc600e5aa44409ea3ce4c2861cb4de1)
I20260618 19:57:05.166247 3918 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 3 FOLLOWER]: Advancing to term 4
I20260618 19:57:05.169162 3918 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:05.169906 3918 leader_election.cc:290] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 4 election: Requested vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975)
I20260618 19:57:05.170451 3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0447960184714aaf886ca15b9aa0e63a" candidate_term: 4 candidate_status { last_received { term: 3 index: 37 } } ignore_live_leader: false dest_uuid: "6c13c838eb85465090e1bff0df28912f"
I20260618 19:57:05.170651 3859 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 2 FOLLOWER]: Advancing to term 4
W20260618 19:57:05.173346 3051 leader_election.cc:336] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 19:57:05.173679 3751 consensus_queue.cc:1048] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:05.177258 3859 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0447960184714aaf886ca15b9aa0e63a in term 4.
I20260618 19:57:05.177757 3053 leader_election.cc:304] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0447960184714aaf886ca15b9aa0e63a, 6c13c838eb85465090e1bff0df28912f; no voters: acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:05.178532 3751 consensus_queue.cc:1048] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:05.179733 3918 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 4 FOLLOWER]: Leader election won for term 4
I20260618 19:57:05.196727 3918 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 4 LEADER]: Becoming Leader. State: Replica: 0447960184714aaf886ca15b9aa0e63a, State: Running, Role: LEADER
I20260618 19:57:05.197410 3918 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 36, Committed index: 36, Last appended: 3.37, Last appended by leader: 37, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:05.202135 3924 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0447960184714aaf886ca15b9aa0e63a. Latest consensus state: current_term: 4 leader_uuid: "0447960184714aaf886ca15b9aa0e63a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:05.202548 3924 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: This master's current role is: LEADER
I20260618 19:57:05.260047 3736 consensus_queue.cc:1048] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:05.268103 3801 consensus_queue.cc:1048] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:05.474850 3034 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:57:05.479876 3034 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260618 19:57:05.521656 3801 consensus_queue.cc:1048] T f45d6e214bb646cdbf84ee1572859863 P 722df47a60ca4bfa82104dea57718f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:05.529119 3801 consensus_queue.cc:1048] T f45d6e214bb646cdbf84ee1572859863 P 722df47a60ca4bfa82104dea57718f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:05.573596 3735 consensus_queue.cc:1048] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:05.579177 3751 consensus_queue.cc:1048] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260618 19:57:05.648289 3051 consensus_peers.cc:597] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a -> Peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Couldn't send request to peer acc600e5aa44409ea3ce4c2861cb4de1. Status: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260618 19:57:05.728919 3801 consensus_queue.cc:1048] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:05.736900 3929 consensus_queue.cc:1048] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:05.744802 3751 consensus_queue.cc:1048] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:05.749950 3929 consensus_queue.cc:1048] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:05.750298 3735 consensus_queue.cc:1048] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:05.761545 3736 consensus_queue.cc:1048] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:05.762369 3859 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 4 FOLLOWER]: Refusing update from remote peer 0447960184714aaf886ca15b9aa0e63a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 38. (index mismatch)
I20260618 19:57:05.763278 3924 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 38, Last known committed idx: 4, Time since last communication: 0.000s
I20260618 19:57:05.763530 3924 consensus_queue.cc:1243] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [LEADER]: Peer 6c13c838eb85465090e1bff0df28912f log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260618 19:57:05.767012 3859 pending_rounds.cc:85] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: Aborting all ops after (but not including) 4
I20260618 19:57:05.767186 3859 pending_rounds.cc:107] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260618 19:57:05.767356 3859 raft_consensus.cc:2889] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260618 19:57:05.778659 3940 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0447960184714aaf886ca15b9aa0e63a. Latest consensus state: current_term: 4 leader_uuid: "0447960184714aaf886ca15b9aa0e63a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:05.779668 3940 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: This master's current role is: FOLLOWER
I20260618 19:57:05.779897 3943 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "0447960184714aaf886ca15b9aa0e63a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:05.780993 3943 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: This master's current role is: FOLLOWER
I20260618 19:57:05.781893 3943 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "0447960184714aaf886ca15b9aa0e63a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:05.782051 3943 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: This master's current role is: FOLLOWER
I20260618 19:57:05.789772 3924 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "0447960184714aaf886ca15b9aa0e63a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:05.790051 3924 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: This master's current role is: LEADER
I20260618 19:57:05.804155 3941 mvcc.cc:204] Tried to move back new op lower bound from 7298304510550085632 to 7298304503062966272. Current Snapshot: MvccSnapshot[applied={T|T < 7298304510550085632}]
I20260618 19:57:05.852385 3925 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260618 19:57:05.855062 3925 catalog_manager.cc:679] Loaded metadata for table default.table_28d033357fdb4b29b0abfeebb5ef122b [id=58a0cd369a884f1fb371a75c1794f738]
I20260618 19:57:05.855558 3925 catalog_manager.cc:679] Loaded metadata for table default.table_e1e6b231bd514a58a66b66d04eff6e48 [id=5a73fe372e7f47b49ed9219558f0194e]
I20260618 19:57:05.855947 3925 catalog_manager.cc:679] Loaded metadata for table default.table_4957212a0ca5452e98630b441906262f [id=749b241f59b34125a9ff8d7c847ddd3d]
I20260618 19:57:05.856357 3925 catalog_manager.cc:679] Loaded metadata for table default.table_4f9cd241b4284c4796f2aba3ccec0e35 [id=873b29232cab4ad9a9f8c070455c98a9]
I20260618 19:57:05.856714 3925 catalog_manager.cc:679] Loaded metadata for table default.table_77c95317631d4b1eab1943139e888ecb [id=aca591adc1fb402ca2dcd58765479d54]
I20260618 19:57:05.857097 3925 catalog_manager.cc:679] Loaded metadata for table default.table_b11e5cb8e5194655b89a8452d2eb25f5 [id=b3a217a305294496bd2ad3d3eed4e179]
I20260618 19:57:05.857609 3925 catalog_manager.cc:679] Loaded metadata for table default.table_8a3fffa237bc419e8921a2b75f70e639 [id=c256b56cd126492ea4f98f7d075e0a53]
I20260618 19:57:05.857973 3925 catalog_manager.cc:679] Loaded metadata for table default.table_736a38f9f9fe4dc7aed9092c9b7b33cb [id=e0eb4bb31ccb4cb58174534059e2ce81]
I20260618 19:57:05.858335 3925 catalog_manager.cc:679] Loaded metadata for table default.table_39c8f72f53c5475bb66b72b21bd13991 [id=e13d5a8056214b30b410b665b7184922]
I20260618 19:57:05.860251 3925 tablet_loader.cc:96] loaded metadata for tablet 45d4e8e879f44a00bb9d84de8b3092dd (table default.table_39c8f72f53c5475bb66b72b21bd13991 [id=e13d5a8056214b30b410b665b7184922])
I20260618 19:57:05.860636 3925 tablet_loader.cc:96] loaded metadata for tablet 48c932d095ea475abc03d02def7e9a27 (table default.table_28d033357fdb4b29b0abfeebb5ef122b [id=58a0cd369a884f1fb371a75c1794f738])
I20260618 19:57:05.860957 3925 tablet_loader.cc:96] loaded metadata for tablet 59b33f9c5c494332a5892a1a1ef9672d (table default.table_4957212a0ca5452e98630b441906262f [id=749b241f59b34125a9ff8d7c847ddd3d])
I20260618 19:57:05.861480 3925 tablet_loader.cc:96] loaded metadata for tablet 99a740f6744048c98e87c484ee2b492b (table default.table_736a38f9f9fe4dc7aed9092c9b7b33cb [id=e0eb4bb31ccb4cb58174534059e2ce81])
I20260618 19:57:05.861954 3925 tablet_loader.cc:96] loaded metadata for tablet b625d21d7f4c4cfeb54de7d636c4a64e (table default.table_77c95317631d4b1eab1943139e888ecb [id=aca591adc1fb402ca2dcd58765479d54])
I20260618 19:57:05.862246 3925 tablet_loader.cc:96] loaded metadata for tablet bce5543840af43b7b9933eb585ceeb80 (table default.table_b11e5cb8e5194655b89a8452d2eb25f5 [id=b3a217a305294496bd2ad3d3eed4e179])
I20260618 19:57:05.862574 3925 tablet_loader.cc:96] loaded metadata for tablet c541a856079f40e18ef4101d82461164 (table default.table_8a3fffa237bc419e8921a2b75f70e639 [id=c256b56cd126492ea4f98f7d075e0a53])
I20260618 19:57:05.862861 3925 tablet_loader.cc:96] loaded metadata for tablet dda398a6683d49c58c7f1ca63a06a8b6 (table default.table_e1e6b231bd514a58a66b66d04eff6e48 [id=5a73fe372e7f47b49ed9219558f0194e])
I20260618 19:57:05.863168 3925 tablet_loader.cc:96] loaded metadata for tablet f45d6e214bb646cdbf84ee1572859863 (table default.table_4f9cd241b4284c4796f2aba3ccec0e35 [id=873b29232cab4ad9a9f8c070455c98a9])
I20260618 19:57:05.863591 3925 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260618 19:57:05.864583 3925 catalog_manager.cc:1294] Loaded cluster ID: 2cd457c38b944bab8903c2f58018327f
I20260618 19:57:05.864693 3925 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260618 19:57:05.865870 3925 catalog_manager.cc:1539] Loading token signing keys...
I20260618 19:57:05.867020 3925 catalog_manager.cc:6080] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: Loaded TSK: 0
I20260618 19:57:05.867877 3925 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260618 19:57:05.868696 3925 catalog_manager.cc:1562] Loading latest processed Hive Metastore notification log event ID...
I20260618 19:57:05.869550 3925 catalog_manager.cc:5918] Last processed Hive Metastore notification event ID: -1
I20260618 19:57:05.912415 3065 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43290:
name: "default.Table_fa143415606c44cf80647e88be53822a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:05.912847 3066 master_service.cc:960] ReplaceTablet: received request to replace tablet 45d4e8e879f44a00bb9d84de8b3092dd from {username='slave'} at 127.0.0.1:43290
I20260618 19:57:05.912813 3067 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43290:
table { table_name: "default.Table_736a38f9f9fe4dc7aed9092c9b7b33cb" } modify_external_catalogs: true
I20260618 19:57:05.913179 3067 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:43290:
table { table_name: "default.Table_736a38f9f9fe4dc7aed9092c9b7b33cb" } modify_external_catalogs: true
I20260618 19:57:05.913637 3061 master_service.cc:960] ReplaceTablet: received request to replace tablet b625d21d7f4c4cfeb54de7d636c4a64e from {username='slave'} at 127.0.0.1:43290
I20260618 19:57:05.913714 3062 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43290:
name: "default.Table_9557e658e4484fffa051fe4e630478d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:05.914332 3063 master_service.cc:960] ReplaceTablet: received request to replace tablet c541a856079f40e18ef4101d82461164 from {username='slave'} at 127.0.0.1:43290
I20260618 19:57:05.915784 3064 master_service.cc:960] ReplaceTablet: received request to replace tablet dda398a6683d49c58c7f1ca63a06a8b6 from {username='slave'} at 127.0.0.1:43290
I20260618 19:57:05.918946 3059 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43290:
table { table_name: "default.Table_77c95317631d4b1eab1943139e888ecb" } modify_external_catalogs: true
I20260618 19:57:05.919195 3059 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:43290:
table { table_name: "default.Table_77c95317631d4b1eab1943139e888ecb" } modify_external_catalogs: true
I20260618 19:57:05.921670 3058 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43290:
name: "default.Table_3354ed02c5b4402089d56d478de4d48b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:05.922361 3060 master_service.cc:960] ReplaceTablet: received request to replace tablet 6dcdf661fe344b90bb6002d07206bd53 from {username='slave'} at 127.0.0.1:43290
I20260618 19:57:05.923331 3060 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43290:
name: "default.Table_131e341c9bb840f7860a9fcaf6a2ec23"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
F20260618 19:57:05.923496 3229 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 1, previous 1; dumping first 2 out of 10 received events: NotificationEvent(eventId=1, eventTime=1781812622, eventType=CREATE_TABLE, dbName=default, tableName=table_402627eeff7b4c338e64cfbe575411be, message={"server":"","servicePrincipal":"","db":"default","table":"table_402627eeff7b4c338e64cfbe575411be","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_402627eeff7b4c338e64cfbe575411be\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1781812622},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/warehouse/table_402627eeff7b4c338e64cfbe575411be\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_402627eeff7b4c338e64cfbe575411be\",\"kudu.table_id\":\"d0b8f5d092934582ab6ebf43cd6f9f6f\",\"transient_lastDdlTime\":\"1781812622\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"2cd457c38b944bab8903c2f58018327f\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1781812622,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=1, eventTime=1781812622, eventType=CREATE_TABLE, dbName=default, tableName=table_4957212a0ca5452e98630b441906262f, message={"server":"","servicePrincipal":"","db":"default","table":"table_4957212a0ca5452e98630b441906262f","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_4957212a0ca5452e98630b441906262f\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1781812622},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/warehouse/table_4957212a0ca5452e98630b441906262f\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_4957212a0ca5452e98630b441906262f\",\"kudu.table_id\":\"749b241f59b34125a9ff8d7c847ddd3d\",\"transient_lastDdlTime\":\"1781812622\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"2cd457c38b944bab8903c2f58018327f\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1781812622,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7f12f26abdcd google::LogMessage::Fail() at ??:0
@ 0x7f12f26afb93 google::LogMessage::SendToLog() at ??:0
@ 0x7f12f26ab7cc google::LogMessage::Flush() at ??:0
@ 0x7f12f26aba11 google::LogMessage::~LogMessage() at ??:0
I20260618 19:57:05.932531 3061 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: Sending DeleteTablet for 3 replicas of tablet b625d21d7f4c4cfeb54de7d636c4a64e
I20260618 19:57:05.935207 3061 catalog_manager.cc:6784] ReplaceTablet: tablet b625d21d7f4c4cfeb54de7d636c4a64e deleted and replaced by tablet ac559ee42eb645058582d38f4ed0e4db
I20260618 19:57:05.936983 3063 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: Sending DeleteTablet for 3 replicas of tablet c541a856079f40e18ef4101d82461164
I20260618 19:57:05.937786 3063 catalog_manager.cc:6784] ReplaceTablet: tablet c541a856079f40e18ef4101d82461164 deleted and replaced by tablet 6dd4cd01d8e94363bec5d2897941d94a
I20260618 19:57:05.964067 3063 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43290:
name: "default.Table_ddc5d076daac47b4bd3e0dacbde21f5f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:05.965672 3061 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43290:
name: "default.Table_62590bf88ede4e85b45e9a0cc4185c2c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:05.981766 3590 tablet_service.cc:1558] Processing DeleteTablet for tablet b625d21d7f4c4cfeb54de7d636c4a64e with delete_type TABLET_DATA_DELETED (replaced by tablet ac559ee42eb645058582d38f4ed0e4db) from {username='slave'} at 127.0.0.1:44022
I20260618 19:57:05.986156 3066 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: Sending DeleteTablet for 3 replicas of tablet 45d4e8e879f44a00bb9d84de8b3092dd
I20260618 19:57:05.986690 3066 catalog_manager.cc:6784] ReplaceTablet: tablet 45d4e8e879f44a00bb9d84de8b3092dd deleted and replaced by tablet 8dd15a7fb224481593155899a99c249c
I20260618 19:57:05.987010 3066 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43290:
table { table_name: "default.Table_8a3fffa237bc419e8921a2b75f70e639" } modify_external_catalogs: true
I20260618 19:57:05.987229 3066 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:43290:
table { table_name: "default.Table_8a3fffa237bc419e8921a2b75f70e639" } modify_external_catalogs: true
I20260618 19:57:05.988448 3307 tablet_service.cc:1558] Processing DeleteTablet for tablet b625d21d7f4c4cfeb54de7d636c4a64e with delete_type TABLET_DATA_DELETED (replaced by tablet ac559ee42eb645058582d38f4ed0e4db) from {username='slave'} at 127.0.0.1:37800
I20260618 19:57:05.988649 3589 tablet_service.cc:1558] Processing DeleteTablet for tablet c541a856079f40e18ef4101d82461164 with delete_type TABLET_DATA_DELETED (replaced by tablet 6dd4cd01d8e94363bec5d2897941d94a) from {username='slave'} at 127.0.0.1:44022
I20260618 19:57:05.989080 3308 tablet_service.cc:1558] Processing DeleteTablet for tablet c541a856079f40e18ef4101d82461164 with delete_type TABLET_DATA_DELETED (replaced by tablet 6dd4cd01d8e94363bec5d2897941d94a) from {username='slave'} at 127.0.0.1:37800
I20260618 19:57:05.989387 3589 tablet_service.cc:1558] Processing DeleteTablet for tablet 45d4e8e879f44a00bb9d84de8b3092dd with delete_type TABLET_DATA_DELETED (replaced by tablet 8dd15a7fb224481593155899a99c249c) from {username='slave'} at 127.0.0.1:44022
I20260618 19:57:05.990073 3962 tablet_replica.cc:333] T b625d21d7f4c4cfeb54de7d636c4a64e P 6bb3ca8239f4412fb8b0e7d0df9e50c1: stopping tablet replica
I20260618 19:57:05.990254 3308 tablet_service.cc:1558] Processing DeleteTablet for tablet 45d4e8e879f44a00bb9d84de8b3092dd with delete_type TABLET_DATA_DELETED (replaced by tablet 8dd15a7fb224481593155899a99c249c) from {username='slave'} at 127.0.0.1:37800
I20260618 19:57:05.990322 3962 raft_consensus.cc:2243] T b625d21d7f4c4cfeb54de7d636c4a64e P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 19:57:05.990574 3962 raft_consensus.cc:2272] T b625d21d7f4c4cfeb54de7d636c4a64e P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:05.993436 3064 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: Sending DeleteTablet for 3 replicas of tablet dda398a6683d49c58c7f1ca63a06a8b6
I20260618 19:57:05.993909 3962 ts_tablet_manager.cc:1916] T b625d21d7f4c4cfeb54de7d636c4a64e P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:05.993957 3064 catalog_manager.cc:6784] ReplaceTablet: tablet dda398a6683d49c58c7f1ca63a06a8b6 deleted and replaced by tablet 729a419e001f43b681075130b9543835
I20260618 19:57:05.996083 3308 tablet_service.cc:1558] Processing DeleteTablet for tablet dda398a6683d49c58c7f1ca63a06a8b6 with delete_type TABLET_DATA_DELETED (replaced by tablet 729a419e001f43b681075130b9543835) from {username='slave'} at 127.0.0.1:37800
I20260618 19:57:05.997380 3064 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43290:
table { table_name: "default.Table_28d033357fdb4b29b0abfeebb5ef122b" } modify_external_catalogs: true
I20260618 19:57:05.997745 3064 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:43290:
table { table_name: "default.Table_28d033357fdb4b29b0abfeebb5ef122b" } modify_external_catalogs: true
I20260618 19:57:06.000674 3447 tablet_service.cc:1558] Processing DeleteTablet for tablet b625d21d7f4c4cfeb54de7d636c4a64e with delete_type TABLET_DATA_DELETED (replaced by tablet ac559ee42eb645058582d38f4ed0e4db) from {username='slave'} at 127.0.0.1:53656
I20260618 19:57:06.001096 3446 tablet_service.cc:1558] Processing DeleteTablet for tablet c541a856079f40e18ef4101d82461164 with delete_type TABLET_DATA_DELETED (replaced by tablet 6dd4cd01d8e94363bec5d2897941d94a) from {username='slave'} at 127.0.0.1:53656
I20260618 19:57:06.001134 3590 tablet_service.cc:1558] Processing DeleteTablet for tablet dda398a6683d49c58c7f1ca63a06a8b6 with delete_type TABLET_DATA_DELETED (replaced by tablet 729a419e001f43b681075130b9543835) from {username='slave'} at 127.0.0.1:44022
I20260618 19:57:06.001477 3444 tablet_service.cc:1558] Processing DeleteTablet for tablet dda398a6683d49c58c7f1ca63a06a8b6 with delete_type TABLET_DATA_DELETED (replaced by tablet 729a419e001f43b681075130b9543835) from {username='slave'} at 127.0.0.1:53656
I20260618 19:57:06.001601 3445 tablet_service.cc:1558] Processing DeleteTablet for tablet 45d4e8e879f44a00bb9d84de8b3092dd with delete_type TABLET_DATA_DELETED (replaced by tablet 8dd15a7fb224481593155899a99c249c) from {username='slave'} at 127.0.0.1:53656
I20260618 19:57:06.003036 3964 tablet_replica.cc:333] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b: stopping tablet replica
I20260618 19:57:06.003077 3963 tablet_replica.cc:333] T b625d21d7f4c4cfeb54de7d636c4a64e P 51c7777f264b496a9bf9511966dcfbd7: stopping tablet replica
I20260618 19:57:06.003336 3963 raft_consensus.cc:2243] T b625d21d7f4c4cfeb54de7d636c4a64e P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 19:57:06.003378 3964 raft_consensus.cc:2243] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b [term 1 LEADER]: Raft consensus shutting down.
I20260618 19:57:06.003669 3963 raft_consensus.cc:2272] T b625d21d7f4c4cfeb54de7d636c4a64e P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:06.003985 3964 raft_consensus.cc:2272] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:06.004617 3963 ts_tablet_manager.cc:1916] T b625d21d7f4c4cfeb54de7d636c4a64e P 51c7777f264b496a9bf9511966dcfbd7: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7f13092a6394 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260618 19:57:06.007881 3447 tablet_service.cc:1511] Processing CreateTablet for tablet 6dd4cd01d8e94363bec5d2897941d94a (DEFAULT_TABLE table=default.table_8a3fffa237bc419e8921a2b75f70e639 [id=c256b56cd126492ea4f98f7d075e0a53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:06.008160 3308 tablet_service.cc:1511] Processing CreateTablet for tablet ac559ee42eb645058582d38f4ed0e4db (DEFAULT_TABLE table=default.table_77c95317631d4b1eab1943139e888ecb [id=aca591adc1fb402ca2dcd58765479d54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:06.008318 3447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dd4cd01d8e94363bec5d2897941d94a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:06.008533 3308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac559ee42eb645058582d38f4ed0e4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:06.008951 3589 tablet_service.cc:1511] Processing CreateTablet for tablet ac559ee42eb645058582d38f4ed0e4db (DEFAULT_TABLE table=default.table_77c95317631d4b1eab1943139e888ecb [id=aca591adc1fb402ca2dcd58765479d54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:06.009449 3589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac559ee42eb645058582d38f4ed0e4db. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f13092a4c41 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260618 19:57:06.013294 3307 tablet_service.cc:1511] Processing CreateTablet for tablet 6dd4cd01d8e94363bec5d2897941d94a (DEFAULT_TABLE table=default.table_8a3fffa237bc419e8921a2b75f70e639 [id=c256b56cd126492ea4f98f7d075e0a53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:06.013703 3307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dd4cd01d8e94363bec5d2897941d94a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:06.013736 3590 tablet_service.cc:1511] Processing CreateTablet for tablet 6dd4cd01d8e94363bec5d2897941d94a (DEFAULT_TABLE table=default.table_8a3fffa237bc419e8921a2b75f70e639 [id=c256b56cd126492ea4f98f7d075e0a53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:06.014163 3590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dd4cd01d8e94363bec5d2897941d94a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:06.014974 3445 tablet_service.cc:1511] Processing CreateTablet for tablet ac559ee42eb645058582d38f4ed0e4db (DEFAULT_TABLE table=default.table_77c95317631d4b1eab1943139e888ecb [id=aca591adc1fb402ca2dcd58765479d54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:06.015390 3445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac559ee42eb645058582d38f4ed0e4db. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f13092ac8bc kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7f13092ac739 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa681d std::function<>::operator()() at ??:?
I20260618 19:57:06.026749 3962 ts_tablet_manager.cc:1929] T b625d21d7f4c4cfeb54de7d636c4a64e P 6bb3ca8239f4412fb8b0e7d0df9e50c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:06.026897 3962 log.cc:1199] T b625d21d7f4c4cfeb54de7d636c4a64e P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/wal/wals/b625d21d7f4c4cfeb54de7d636c4a64e
I20260618 19:57:06.027336 3962 ts_tablet_manager.cc:1950] T b625d21d7f4c4cfeb54de7d636c4a64e P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting consensus metadata
I20260618 19:57:06.027942 3963 ts_tablet_manager.cc:1929] T b625d21d7f4c4cfeb54de7d636c4a64e P 51c7777f264b496a9bf9511966dcfbd7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:06.028057 3963 log.cc:1199] T b625d21d7f4c4cfeb54de7d636c4a64e P 51c7777f264b496a9bf9511966dcfbd7: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-0/wal/wals/b625d21d7f4c4cfeb54de7d636c4a64e
I20260618 19:57:06.028409 3962 tablet_replica.cc:333] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: stopping tablet replica
I20260618 19:57:06.028482 3963 ts_tablet_manager.cc:1950] T b625d21d7f4c4cfeb54de7d636c4a64e P 51c7777f264b496a9bf9511966dcfbd7: Deleting consensus metadata
I20260618 19:57:06.028982 3054 catalog_manager.cc:5027] TS 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): tablet b625d21d7f4c4cfeb54de7d636c4a64e (table default.table_77c95317631d4b1eab1943139e888ecb [id=aca591adc1fb402ca2dcd58765479d54]) successfully deleted
@ 0x7f12f53d2f49 kudu::Thread::SuperviseThread() at ??:0
I20260618 19:57:06.030750 3967 tablet_bootstrap.cc:492] T ac559ee42eb645058582d38f4ed0e4db P 51c7777f264b496a9bf9511966dcfbd7: Bootstrap starting.
I20260618 19:57:06.031206 3964 ts_tablet_manager.cc:1916] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7f12f8a9c6db start_thread at ??:0
I20260618 19:57:06.034066 3966 tablet_bootstrap.cc:492] T 6dd4cd01d8e94363bec5d2897941d94a P 722df47a60ca4bfa82104dea57718f3b: Bootstrap starting.
@ 0x7f12f155a61f clone at ??:0
I20260618 19:57:06.035297 3968 tablet_bootstrap.cc:492] T 6dd4cd01d8e94363bec5d2897941d94a P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Bootstrap starting.
I20260618 19:57:06.035666 3962 raft_consensus.cc:2243] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 LEADER]: Raft consensus shutting down.
I20260618 19:57:06.036041 3962 raft_consensus.cc:2272] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:06.036674 3962 ts_tablet_manager.cc:1916] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:06.037356 3968 tablet_bootstrap.cc:654] T 6dd4cd01d8e94363bec5d2897941d94a P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:06.037777 3967 tablet_bootstrap.cc:654] T ac559ee42eb645058582d38f4ed0e4db P 51c7777f264b496a9bf9511966dcfbd7: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:06.038985 3963 tablet_replica.cc:333] T c541a856079f40e18ef4101d82461164 P 51c7777f264b496a9bf9511966dcfbd7: stopping tablet replica
I20260618 19:57:06.039198 3963 raft_consensus.cc:2243] T c541a856079f40e18ef4101d82461164 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 19:57:06.039366 3963 raft_consensus.cc:2272] T c541a856079f40e18ef4101d82461164 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:06.040179 3964 ts_tablet_manager.cc:1929] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:06.040324 3964 log.cc:1199] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-1/wal/wals/b625d21d7f4c4cfeb54de7d636c4a64e
I20260618 19:57:06.040871 3964 ts_tablet_manager.cc:1950] T b625d21d7f4c4cfeb54de7d636c4a64e P 722df47a60ca4bfa82104dea57718f3b: Deleting consensus metadata
I20260618 19:57:06.041101 3963 ts_tablet_manager.cc:1916] T c541a856079f40e18ef4101d82461164 P 51c7777f264b496a9bf9511966dcfbd7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:06.042264 3964 tablet_replica.cc:333] T c541a856079f40e18ef4101d82461164 P 722df47a60ca4bfa82104dea57718f3b: stopping tablet replica
I20260618 19:57:06.042559 3964 raft_consensus.cc:2243] T c541a856079f40e18ef4101d82461164 P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 19:57:06.042770 3964 raft_consensus.cc:2272] T c541a856079f40e18ef4101d82461164 P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:06.043471 3964 ts_tablet_manager.cc:1916] T c541a856079f40e18ef4101d82461164 P 722df47a60ca4bfa82104dea57718f3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:06.043574 3962 ts_tablet_manager.cc:1929] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:06.043712 3962 log.cc:1199] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/wal/wals/c541a856079f40e18ef4101d82461164
I20260618 19:57:06.044173 3962 ts_tablet_manager.cc:1950] T c541a856079f40e18ef4101d82461164 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting consensus metadata
I20260618 19:57:06.045198 3962 tablet_replica.cc:333] T 45d4e8e879f44a00bb9d84de8b3092dd P 6bb3ca8239f4412fb8b0e7d0df9e50c1: stopping tablet replica
I20260618 19:57:06.046671 3966 tablet_bootstrap.cc:654] T 6dd4cd01d8e94363bec5d2897941d94a P 722df47a60ca4bfa82104dea57718f3b: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:06.047946 3968 tablet_bootstrap.cc:492] T 6dd4cd01d8e94363bec5d2897941d94a P 6bb3ca8239f4412fb8b0e7d0df9e50c1: No bootstrap required, opened a new log
I20260618 19:57:06.048079 3968 ts_tablet_manager.cc:1403] T 6dd4cd01d8e94363bec5d2897941d94a P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.008s
I20260618 19:57:06.048609 3967 tablet_bootstrap.cc:492] T ac559ee42eb645058582d38f4ed0e4db P 51c7777f264b496a9bf9511966dcfbd7: No bootstrap required, opened a new log
I20260618 19:57:06.048748 3967 ts_tablet_manager.cc:1403] T ac559ee42eb645058582d38f4ed0e4db P 51c7777f264b496a9bf9511966dcfbd7: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260618 19:57:06.048918 3968 raft_consensus.cc:359] T 6dd4cd01d8e94363bec5d2897941d94a P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } }
I20260618 19:57:06.049105 3968 raft_consensus.cc:385] T 6dd4cd01d8e94363bec5d2897941d94a P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:06.049185 3968 raft_consensus.cc:740] T 6dd4cd01d8e94363bec5d2897941d94a P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb3ca8239f4412fb8b0e7d0df9e50c1, State: Initialized, Role: FOLLOWER
I20260618 19:57:06.049495 3968 consensus_queue.cc:260] T 6dd4cd01d8e94363bec5d2897941d94a P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } }
I20260618 19:57:06.049719 3967 raft_consensus.cc:359] T ac559ee42eb645058582d38f4ed0e4db P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:06.049912 3967 raft_consensus.cc:385] T ac559ee42eb645058582d38f4ed0e4db P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:06.050027 3967 raft_consensus.cc:740] T ac559ee42eb645058582d38f4ed0e4db P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51c7777f264b496a9bf9511966dcfbd7, State: Initialized, Role: FOLLOWER
I20260618 19:57:06.050721 3658 heartbeater.cc:499] Master 127.2.158.189:45955 was elected leader, sending a full tablet report...
I20260618 19:57:06.050968 3964 ts_tablet_manager.cc:1929] T c541a856079f40e18ef4101d82461164 P 722df47a60ca4bfa82104dea57718f3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:06.051100 3964 log.cc:1199] T c541a856079f40e18ef4101d82461164 P 722df47a60ca4bfa82104dea57718f3b: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-1/wal/wals/c541a856079f40e18ef4101d82461164
I20260618 19:57:06.051541 3964 ts_tablet_manager.cc:1950] T c541a856079f40e18ef4101d82461164 P 722df47a60ca4bfa82104dea57718f3b: Deleting consensus metadata
I20260618 19:57:06.052639 3964 tablet_replica.cc:333] T dda398a6683d49c58c7f1ca63a06a8b6 P 722df47a60ca4bfa82104dea57718f3b: stopping tablet replica
I20260618 19:57:06.052821 3964 raft_consensus.cc:2243] T dda398a6683d49c58c7f1ca63a06a8b6 P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 19:57:06.053017 3964 raft_consensus.cc:2272] T dda398a6683d49c58c7f1ca63a06a8b6 P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:06.053493 3962 raft_consensus.cc:2243] T 45d4e8e879f44a00bb9d84de8b3092dd P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 19:57:06.053699 3962 raft_consensus.cc:2272] T 45d4e8e879f44a00bb9d84de8b3092dd P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:06.053830 3964 ts_tablet_manager.cc:1916] T dda398a6683d49c58c7f1ca63a06a8b6 P 722df47a60ca4bfa82104dea57718f3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:06.054555 3962 ts_tablet_manager.cc:1916] T 45d4e8e879f44a00bb9d84de8b3092dd P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:06.054387 3967 consensus_queue.cc:260] T ac559ee42eb645058582d38f4ed0e4db P 51c7777f264b496a9bf9511966dcfbd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:06.055241 3968 ts_tablet_manager.cc:1434] T 6dd4cd01d8e94363bec5d2897941d94a P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260618 19:57:06.057986 3968 tablet_bootstrap.cc:492] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Bootstrap starting.
I20260618 19:57:06.060086 3964 ts_tablet_manager.cc:1929] T dda398a6683d49c58c7f1ca63a06a8b6 P 722df47a60ca4bfa82104dea57718f3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:06.060227 3964 log.cc:1199] T dda398a6683d49c58c7f1ca63a06a8b6 P 722df47a60ca4bfa82104dea57718f3b: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-1/wal/wals/dda398a6683d49c58c7f1ca63a06a8b6
I20260618 19:57:06.060454 3967 ts_tablet_manager.cc:1434] T ac559ee42eb645058582d38f4ed0e4db P 51c7777f264b496a9bf9511966dcfbd7: Time spent starting tablet: real 0.012s user 0.003s sys 0.000s
I20260618 19:57:06.060640 3968 tablet_bootstrap.cc:654] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:06.060679 3964 ts_tablet_manager.cc:1950] T dda398a6683d49c58c7f1ca63a06a8b6 P 722df47a60ca4bfa82104dea57718f3b: Deleting consensus metadata
I20260618 19:57:06.061928 3964 tablet_replica.cc:333] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b: stopping tablet replica
I20260618 19:57:06.062137 3964 raft_consensus.cc:2243] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b [term 1 LEADER]: Raft consensus shutting down.
I20260618 19:57:06.062485 3964 raft_consensus.cc:2272] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:06.063145 3962 ts_tablet_manager.cc:1929] T 45d4e8e879f44a00bb9d84de8b3092dd P 6bb3ca8239f4412fb8b0e7d0df9e50c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:06.063252 3962 log.cc:1199] T 45d4e8e879f44a00bb9d84de8b3092dd P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/wal/wals/45d4e8e879f44a00bb9d84de8b3092dd
I20260618 19:57:06.063371 3964 ts_tablet_manager.cc:1916] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:06.063666 3962 ts_tablet_manager.cc:1950] T 45d4e8e879f44a00bb9d84de8b3092dd P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting consensus metadata
I20260618 19:57:06.064710 3962 tablet_replica.cc:333] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: stopping tablet replica
I20260618 19:57:06.064893 3962 raft_consensus.cc:2243] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 LEADER]: Raft consensus shutting down.
I20260618 19:57:06.065085 3967 tablet_bootstrap.cc:492] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7: Bootstrap starting.
I20260618 19:57:06.065198 3962 raft_consensus.cc:2272] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:06.066054 3962 ts_tablet_manager.cc:1916] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:06.066452 3966 tablet_bootstrap.cc:492] T 6dd4cd01d8e94363bec5d2897941d94a P 722df47a60ca4bfa82104dea57718f3b: No bootstrap required, opened a new log
I20260618 19:57:06.066591 3966 ts_tablet_manager.cc:1403] T 6dd4cd01d8e94363bec5d2897941d94a P 722df47a60ca4bfa82104dea57718f3b: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.000s
I20260618 19:57:06.067389 3966 raft_consensus.cc:359] T 6dd4cd01d8e94363bec5d2897941d94a P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } }
I20260618 19:57:06.067575 3966 raft_consensus.cc:385] T 6dd4cd01d8e94363bec5d2897941d94a P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:06.067662 3966 raft_consensus.cc:740] T 6dd4cd01d8e94363bec5d2897941d94a P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 722df47a60ca4bfa82104dea57718f3b, State: Initialized, Role: FOLLOWER
I20260618 19:57:06.067906 3966 consensus_queue.cc:260] T 6dd4cd01d8e94363bec5d2897941d94a P 722df47a60ca4bfa82104dea57718f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } }
I20260618 19:57:06.070655 3964 ts_tablet_manager.cc:1929] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:06.070799 3964 log.cc:1199] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-1/wal/wals/45d4e8e879f44a00bb9d84de8b3092dd
I20260618 19:57:06.071219 3966 ts_tablet_manager.cc:1434] T 6dd4cd01d8e94363bec5d2897941d94a P 722df47a60ca4bfa82104dea57718f3b: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260618 19:57:06.071301 3964 ts_tablet_manager.cc:1950] T 45d4e8e879f44a00bb9d84de8b3092dd P 722df47a60ca4bfa82104dea57718f3b: Deleting consensus metadata
I20260618 19:57:06.071596 3968 tablet_bootstrap.cc:492] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1: No bootstrap required, opened a new log
I20260618 19:57:06.071758 3968 ts_tablet_manager.cc:1403] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.002s
I20260618 19:57:06.072609 3968 raft_consensus.cc:359] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:06.072813 3968 raft_consensus.cc:385] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:06.072901 3968 raft_consensus.cc:740] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb3ca8239f4412fb8b0e7d0df9e50c1, State: Initialized, Role: FOLLOWER
I20260618 19:57:06.073203 3968 consensus_queue.cc:260] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:06.075754 3968 ts_tablet_manager.cc:1434] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260618 19:57:06.076769 3966 tablet_bootstrap.cc:492] T ac559ee42eb645058582d38f4ed0e4db P 722df47a60ca4bfa82104dea57718f3b: Bootstrap starting.
I20260618 19:57:06.079061 3962 ts_tablet_manager.cc:1929] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:06.079222 3962 log.cc:1199] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/wal/wals/dda398a6683d49c58c7f1ca63a06a8b6
I20260618 19:57:06.079670 3962 ts_tablet_manager.cc:1950] T dda398a6683d49c58c7f1ca63a06a8b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting consensus metadata
I20260618 19:57:06.080664 3966 tablet_bootstrap.cc:654] T ac559ee42eb645058582d38f4ed0e4db P 722df47a60ca4bfa82104dea57718f3b: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:06.080832 3967 tablet_bootstrap.cc:654] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:06.082768 3963 ts_tablet_manager.cc:1929] T c541a856079f40e18ef4101d82461164 P 51c7777f264b496a9bf9511966dcfbd7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:06.082940 3963 log.cc:1199] T c541a856079f40e18ef4101d82461164 P 51c7777f264b496a9bf9511966dcfbd7: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-0/wal/wals/c541a856079f40e18ef4101d82461164
I20260618 19:57:06.083539 3963 ts_tablet_manager.cc:1950] T c541a856079f40e18ef4101d82461164 P 51c7777f264b496a9bf9511966dcfbd7: Deleting consensus metadata
I20260618 19:57:06.085039 3963 tablet_replica.cc:333] T 45d4e8e879f44a00bb9d84de8b3092dd P 51c7777f264b496a9bf9511966dcfbd7: stopping tablet replica
I20260618 19:57:06.085306 3963 raft_consensus.cc:2243] T 45d4e8e879f44a00bb9d84de8b3092dd P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 19:57:06.085520 3963 raft_consensus.cc:2272] T 45d4e8e879f44a00bb9d84de8b3092dd P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:06.086767 3963 ts_tablet_manager.cc:1916] T 45d4e8e879f44a00bb9d84de8b3092dd P 51c7777f264b496a9bf9511966dcfbd7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:06.091486 3966 tablet_bootstrap.cc:492] T ac559ee42eb645058582d38f4ed0e4db P 722df47a60ca4bfa82104dea57718f3b: No bootstrap required, opened a new log
I20260618 19:57:06.091650 3966 ts_tablet_manager.cc:1403] T ac559ee42eb645058582d38f4ed0e4db P 722df47a60ca4bfa82104dea57718f3b: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.006s
I20260618 19:57:06.092439 3966 raft_consensus.cc:359] T ac559ee42eb645058582d38f4ed0e4db P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:06.092644 3966 raft_consensus.cc:385] T ac559ee42eb645058582d38f4ed0e4db P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:06.092725 3966 raft_consensus.cc:740] T ac559ee42eb645058582d38f4ed0e4db P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 722df47a60ca4bfa82104dea57718f3b, State: Initialized, Role: FOLLOWER
I20260618 19:57:06.093014 3966 consensus_queue.cc:260] T ac559ee42eb645058582d38f4ed0e4db P 722df47a60ca4bfa82104dea57718f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:06.093968 3963 ts_tablet_manager.cc:1929] T 45d4e8e879f44a00bb9d84de8b3092dd P 51c7777f264b496a9bf9511966dcfbd7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:06.094086 3963 log.cc:1199] T 45d4e8e879f44a00bb9d84de8b3092dd P 51c7777f264b496a9bf9511966dcfbd7: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-0/wal/wals/45d4e8e879f44a00bb9d84de8b3092dd
I20260618 19:57:06.094527 3963 ts_tablet_manager.cc:1950] T 45d4e8e879f44a00bb9d84de8b3092dd P 51c7777f264b496a9bf9511966dcfbd7: Deleting consensus metadata
I20260618 19:57:06.095551 3963 tablet_replica.cc:333] T dda398a6683d49c58c7f1ca63a06a8b6 P 51c7777f264b496a9bf9511966dcfbd7: stopping tablet replica
I20260618 19:57:06.095747 3963 raft_consensus.cc:2243] T dda398a6683d49c58c7f1ca63a06a8b6 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 19:57:06.095916 3963 raft_consensus.cc:2272] T dda398a6683d49c58c7f1ca63a06a8b6 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:06.096791 3963 ts_tablet_manager.cc:1916] T dda398a6683d49c58c7f1ca63a06a8b6 P 51c7777f264b496a9bf9511966dcfbd7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:06.097289 3966 ts_tablet_manager.cc:1434] T ac559ee42eb645058582d38f4ed0e4db P 722df47a60ca4bfa82104dea57718f3b: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260618 19:57:06.102773 3967 tablet_bootstrap.cc:492] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7: No bootstrap required, opened a new log
I20260618 19:57:06.102953 3967 ts_tablet_manager.cc:1403] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7: Time spent bootstrapping tablet: real 0.038s user 0.014s sys 0.009s
I20260618 19:57:06.103855 3967 raft_consensus.cc:359] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } }
I20260618 19:57:06.104074 3967 raft_consensus.cc:385] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:06.104153 3967 raft_consensus.cc:740] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51c7777f264b496a9bf9511966dcfbd7, State: Initialized, Role: FOLLOWER
I20260618 19:57:06.104184 3963 ts_tablet_manager.cc:1929] T dda398a6683d49c58c7f1ca63a06a8b6 P 51c7777f264b496a9bf9511966dcfbd7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:06.104339 3963 log.cc:1199] T dda398a6683d49c58c7f1ca63a06a8b6 P 51c7777f264b496a9bf9511966dcfbd7: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-0/wal/wals/dda398a6683d49c58c7f1ca63a06a8b6
I20260618 19:57:06.104507 3967 consensus_queue.cc:260] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } }
I20260618 19:57:06.104787 3963 ts_tablet_manager.cc:1950] T dda398a6683d49c58c7f1ca63a06a8b6 P 51c7777f264b496a9bf9511966dcfbd7: Deleting consensus metadata
I20260618 19:57:06.105218 3967 ts_tablet_manager.cc:1434] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260618 19:57:06.108606 3760 raft_consensus.cc:493] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:06.108767 3760 raft_consensus.cc:515] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:06.109431 3760 leader_election.cc:290] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483)
I20260618 19:57:06.110016 3328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac559ee42eb645058582d38f4ed0e4db" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7" is_pre_election: true
I20260618 19:57:06.110128 3467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac559ee42eb645058582d38f4ed0e4db" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "722df47a60ca4bfa82104dea57718f3b" is_pre_election: true
I20260618 19:57:06.110239 3328 raft_consensus.cc:2468] T ac559ee42eb645058582d38f4ed0e4db P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 0.
I20260618 19:57:06.110373 3467 raft_consensus.cc:2468] T ac559ee42eb645058582d38f4ed0e4db P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 0.
I20260618 19:57:06.110721 3546 leader_election.cc:304] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7, 6bb3ca8239f4412fb8b0e7d0df9e50c1; no voters:
I20260618 19:57:06.111025 3760 raft_consensus.cc:2804] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 19:57:06.111129 3760 raft_consensus.cc:493] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 19:57:06.111205 3760 raft_consensus.cc:3060] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:06.111845 3737 raft_consensus.cc:493] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:06.111990 3737 raft_consensus.cc:515] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } }
I20260618 19:57:06.112660 3737 leader_election.cc:290] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071), 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483)
I20260618 19:57:06.113679 3610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd4cd01d8e94363bec5d2897941d94a" candidate_uuid: "51c7777f264b496a9bf9511966dcfbd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" is_pre_election: true
I20260618 19:57:06.113700 3467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd4cd01d8e94363bec5d2897941d94a" candidate_uuid: "51c7777f264b496a9bf9511966dcfbd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "722df47a60ca4bfa82104dea57718f3b" is_pre_election: true
I20260618 19:57:06.113864 3610 raft_consensus.cc:2468] T 6dd4cd01d8e94363bec5d2897941d94a P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51c7777f264b496a9bf9511966dcfbd7 in term 0.
I20260618 19:57:06.113903 3467 raft_consensus.cc:2468] T 6dd4cd01d8e94363bec5d2897941d94a P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51c7777f264b496a9bf9511966dcfbd7 in term 0.
I20260618 19:57:06.114197 3760 raft_consensus.cc:515] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:06.114668 3264 leader_election.cc:304] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7, 722df47a60ca4bfa82104dea57718f3b; no voters:
I20260618 19:57:06.115166 3760 leader_election.cc:290] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 election: Requested vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483)
I20260618 19:57:06.115561 3328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac559ee42eb645058582d38f4ed0e4db" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7"
I20260618 19:57:06.115689 3737 raft_consensus.cc:2804] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 19:57:06.115749 3328 raft_consensus.cc:3060] T ac559ee42eb645058582d38f4ed0e4db P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:06.115818 3737 raft_consensus.cc:493] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 19:57:06.115912 3737 raft_consensus.cc:3060] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:06.119112 3328 raft_consensus.cc:2468] T ac559ee42eb645058582d38f4ed0e4db P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 1.
I20260618 19:57:06.119526 3467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac559ee42eb645058582d38f4ed0e4db" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "722df47a60ca4bfa82104dea57718f3b"
I20260618 19:57:06.119640 3546 leader_election.cc:304] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7, 6bb3ca8239f4412fb8b0e7d0df9e50c1; no voters:
I20260618 19:57:06.119725 3467 raft_consensus.cc:3060] T ac559ee42eb645058582d38f4ed0e4db P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:06.119979 3760 raft_consensus.cc:2804] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 19:57:06.119267 3737 raft_consensus.cc:515] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } }
I20260618 19:57:06.121330 3610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd4cd01d8e94363bec5d2897941d94a" candidate_uuid: "51c7777f264b496a9bf9511966dcfbd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1"
I20260618 19:57:06.121510 3610 raft_consensus.cc:3060] T 6dd4cd01d8e94363bec5d2897941d94a P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:06.122642 3467 raft_consensus.cc:2468] T ac559ee42eb645058582d38f4ed0e4db P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 1.
I20260618 19:57:06.122854 3760 raft_consensus.cc:697] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 LEADER]: Becoming Leader. State: Replica: 6bb3ca8239f4412fb8b0e7d0df9e50c1, State: Running, Role: LEADER
I20260618 19:57:06.123242 3760 consensus_queue.cc:237] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:06.124413 3610 raft_consensus.cc:2468] T 6dd4cd01d8e94363bec5d2897941d94a P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51c7777f264b496a9bf9511966dcfbd7 in term 1.
I20260618 19:57:06.124456 3467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd4cd01d8e94363bec5d2897941d94a" candidate_uuid: "51c7777f264b496a9bf9511966dcfbd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "722df47a60ca4bfa82104dea57718f3b"
I20260618 19:57:06.124894 3737 leader_election.cc:290] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7 [CANDIDATE]: Term 1 election: Requested vote from peers 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071), 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483)
I20260618 19:57:06.124989 3264 leader_election.cc:304] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7, 6bb3ca8239f4412fb8b0e7d0df9e50c1; no voters:
I20260618 19:57:06.125345 3467 raft_consensus.cc:3060] T 6dd4cd01d8e94363bec5d2897941d94a P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:06.128448 3467 raft_consensus.cc:2468] T 6dd4cd01d8e94363bec5d2897941d94a P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51c7777f264b496a9bf9511966dcfbd7 in term 1.
I20260618 19:57:06.129142 3737 raft_consensus.cc:2804] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 19:57:06.129657 3737 raft_consensus.cc:697] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7 [term 1 LEADER]: Becoming Leader. State: Replica: 51c7777f264b496a9bf9511966dcfbd7, State: Running, Role: LEADER
I20260618 19:57:06.130790 3737 consensus_queue.cc:237] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } }
W20260618 19:57:06.274403 3668 connection.cc:573] client connection to 127.2.158.189:45955 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260618 19:57:06.274448 3402 connection.cc:573] client connection to 127.2.158.189:45955 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260618 19:57:06.274468 3544 connection.cc:573] server connection from 127.0.0.1:44022 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260618 19:57:06.275066 3546 connection.cc:573] client connection to 127.2.158.189:45955 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260618 19:57:06.275223 3668 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.2.158.189:45955)
W20260618 19:57:06.275303 3403 connection.cc:573] server connection from 127.0.0.1:53656 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260618 19:57:06.275833 3668 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.2.158.189:45955)
W20260618 19:57:06.276073 3668 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.2.158.189:45955)
W20260618 19:57:06.276485 3761 negotiation.cc:336] Failed RPC negotiation. Trace:
0618 19:57:06.275756 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.2.158.189:45955 (local address 127.2.158.130:38815)
0618 19:57:06.276203 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0618 19:57:06.276291 (+ 88us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":287}
W20260618 19:57:06.276657 3262 connection.cc:573] server connection from 127.0.0.1:37800 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260618 19:57:06.276885 3668 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.2.158.189:45955)
W20260618 19:57:06.276947 3263 connection.cc:573] client connection to 127.2.158.189:45955 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260618 19:57:06.534759 3988 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0447960184714aaf886ca15b9aa0e63a)
I20260618 19:57:06.534983 3988 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:06.537015 3988 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:57:06.538004 3831 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:57:06.539791 3831 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:57:06.540014 3834 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 19:57:06.540160 3834 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:06.540544 3988 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260618 19:57:06.982339 3999 consensus_queue.cc:1048] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:06.987821 3999 consensus_queue.cc:1048] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:07.089803 3993 consensus_queue.cc:1048] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:07.095332 3993 consensus_queue.cc:1048] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:07.176867 4010 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0447960184714aaf886ca15b9aa0e63a)
I20260618 19:57:07.177073 4010 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:07.178102 4010 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:57:07.180279 3831 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:57:07.180502 3834 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 19:57:07.180626 3834 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:07.180968 4010 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260618 19:57:07.220901 2682 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task_3iVrE/build/asan/bin/kudu pid 3758
I20260618 19:57:07.228999 3879 generic_service.cc:196] Checking for leaks (request via RPC)
I20260618 19:57:07.350865 2682 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task_3iVrE/build/asan/bin/kudu with pid 3758
I20260618 19:57:08.363442 2682 external_mini_cluster.cc:1372] Running /tmp/dist-test-task_3iVrE/build/asan/bin/kudu
/tmp/dist-test-task_3iVrE/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.158.188:34975
--webserver_interface=127.2.158.188
--webserver_port=36245
--builtin_ntp_servers=127.2.158.148:40109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975
--hive_metastore_uris=thrift://127.0.0.1:43379
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260618 19:57:08.733335 4030 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 19:57:08.733810 4030 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 19:57:08.733932 4030 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260618 19:57:08.744865 4030 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 19:57:08.745028 4030 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260618 19:57:08.745121 4030 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 19:57:08.745186 4030 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260618 19:57:08.757654 4030 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.158.148:40109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:43379
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.158.188:34975
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.2.158.188
--webserver_port=36245
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 18 Jun 2026 19:43:24 UTC on bdcb31816ec0
build id 12458
ASAN enabled
I20260618 19:57:08.759362 4030 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 19:57:08.761117 4030 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260618 19:57:08.771353 4041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 19:57:08.771546 4040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 19:57:08.772198 4043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 19:57:08.772955 4030 server_base.cc:1061] running on GCE node
I20260618 19:57:08.773872 4030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 19:57:08.775586 4030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 19:57:08.776856 4030 hybrid_clock.cc:648] HybridClock initialized: now 1781812628776791 us; error 58 us; skew 500 ppm
I20260618 19:57:08.777460 4030 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260618 19:57:08.780151 4030 webserver.cc:533] Webserver started at http://127.2.158.188:36245/ using document root <none> and password file <none>
I20260618 19:57:08.780928 4030 fs_manager.cc:362] Metadata directory not provided
I20260618 19:57:08.781028 4030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 19:57:08.787029 4030 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.004s sys 0.001s
I20260618 19:57:08.790555 4049 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 19:57:08.792166 4030 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260618 19:57:08.792405 4030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data,/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/wal
uuid: "6c13c838eb85465090e1bff0df28912f"
format_stamp: "Formatted at 2026-06-18 19:57:00 on dist-test-slave-6zlr"
I20260618 19:57:08.793215 4030 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 19:57:08.817854 4030 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 19:57:08.818801 4030 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 19:57:08.819130 4030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 19:57:08.842026 4030 rpc_server.cc:307] RPC server started. Bound to: 127.2.158.188:34975
I20260618 19:57:08.842049 4100 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.158.188:34975 every 8 connection(s)
I20260618 19:57:08.843750 4030 server_base.cc:1193] Dumped server information to /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data/info.pb
I20260618 19:57:08.847312 2682 external_mini_cluster.cc:1434] Started /tmp/dist-test-task_3iVrE/build/asan/bin/kudu as pid 4030
I20260618 19:57:08.852880 4102 sys_catalog.cc:263] Verifying existing consensus state
I20260618 19:57:08.857205 4102 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: Bootstrap starting.
I20260618 19:57:08.869344 4102 log.cc:826] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: Log is configured to *not* fsync() on all Append() calls
I20260618 19:57:08.905838 4102 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: Bootstrap replayed 1/1 log segments. Stats: ops{read=45 overwritten=1 applied=44 ignored=0} inserts{seen=29 ignored=0} mutations{seen=32 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260618 19:57:08.906474 4102 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: Bootstrap complete.
I20260618 19:57:08.911906 4102 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:08.912925 4102 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c13c838eb85465090e1bff0df28912f, State: Initialized, Role: FOLLOWER
I20260618 19:57:08.913793 4102 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 44, Last appended: 4.44, Last appended by leader: 44, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:08.914721 4106 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:08.914968 4106 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: This master's current role is: FOLLOWER
I20260618 19:57:08.915860 4102 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: configured and running, proceeding with master startup.
I20260618 19:57:08.930895 4120 catalog_manager.cc:1294] Loaded cluster ID: 2cd457c38b944bab8903c2f58018327f
I20260618 19:57:08.931011 4120 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: loading cluster ID for follower catalog manager: success
I20260618 19:57:08.927839 4030 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:57:08.933799 4030 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260618 19:57:08.935300 4120 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: acquiring CA information for follower catalog manager: success
I20260618 19:57:08.938274 4120 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260618 19:57:09.067389 3374 heartbeater.cc:344] Connected to a master server at 127.2.158.188:34975
I20260618 19:57:09.070289 4066 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" instance_seqno: 1781812621349212) as {username='slave'} at 127.2.158.129:54829; Asking this server to re-register.
I20260618 19:57:09.071014 3374 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:09.072935 4066 ts_manager.cc:194] Registered new tserver with Master: 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205)
I20260618 19:57:09.113034 3513 heartbeater.cc:344] Connected to a master server at 127.2.158.188:34975
I20260618 19:57:09.114434 4066 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" instance_seqno: 1781812621902304) as {username='slave'} at 127.2.158.130:36185; Asking this server to re-register.
I20260618 19:57:09.114962 3513 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:09.116202 4066 ts_manager.cc:194] Registered new tserver with Master: 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483)
I20260618 19:57:09.229089 3657 heartbeater.cc:344] Connected to a master server at 127.2.158.188:34975
I20260618 19:57:09.230931 4066 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" instance_seqno: 1781812622463911) as {username='slave'} at 127.2.158.131:44473; Asking this server to re-register.
I20260618 19:57:09.231590 3657 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:09.232930 4066 ts_manager.cc:194] Registered new tserver with Master: 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:09.519138 4130 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:09.519650 4130 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:09.521633 4130 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:57:09.522722 4050 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:57:09.524183 4052 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
W20260618 19:57:09.524416 4050 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 19:57:09.524574 4050 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:09.525000 4130 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260618 19:57:10.165917 4142 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:10.166189 4142 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:10.167037 4142 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:57:10.169363 4050 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:57:10.169649 4052 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 19:57:10.169843 4052 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:10.170140 4142 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260618 19:57:10.782684 4155 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:10.782902 4155 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:10.783959 4155 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:57:10.786314 4052 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
W20260618 19:57:10.786586 4050 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 19:57:10.786736 4050 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:10.787091 4155 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260618 19:57:11.739163 2682 external_mini_cluster.cc:1372] Running /tmp/dist-test-task_3iVrE/build/asan/bin/kudu
/tmp/dist-test-task_3iVrE/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.158.190:41233
--webserver_interface=127.2.158.190
--webserver_port=46621
--builtin_ntp_servers=127.2.158.148:40109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975
--hive_metastore_uris=thrift://127.0.0.1:43379
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260618 19:57:11.796581 4175 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:11.796797 4175 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:11.797691 4175 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:57:11.800294 4050 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:57:11.800496 4052 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 19:57:11.800650 4052 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:11.800956 4175 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260618 19:57:12.099447 4173 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 19:57:12.099817 4173 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 19:57:12.099891 4173 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260618 19:57:12.108712 4173 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 19:57:12.108880 4173 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260618 19:57:12.108981 4173 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 19:57:12.109035 4173 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260618 19:57:12.122424 4173 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.158.148:40109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:43379
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.158.190:41233
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.158.190
--webserver_port=46621
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 18 Jun 2026 19:43:24 UTC on bdcb31816ec0
build id 12458
ASAN enabled
I20260618 19:57:12.124078 4173 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 19:57:12.125963 4173 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260618 19:57:12.134976 4188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 19:57:12.134950 4187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 19:57:12.135771 4190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 19:57:12.136653 4173 server_base.cc:1061] running on GCE node
I20260618 19:57:12.137506 4173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 19:57:12.138995 4173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 19:57:12.140242 4173 hybrid_clock.cc:648] HybridClock initialized: now 1781812632140207 us; error 58 us; skew 500 ppm
I20260618 19:57:12.140630 4173 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260618 19:57:12.143049 4173 webserver.cc:533] Webserver started at http://127.2.158.190:46621/ using document root <none> and password file <none>
I20260618 19:57:12.144026 4173 fs_manager.cc:362] Metadata directory not provided
I20260618 19:57:12.144191 4173 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 19:57:12.149524 4173 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260618 19:57:12.153057 4196 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 19:57:12.155036 4173 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260618 19:57:12.155251 4173 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/data,/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/wal
uuid: "acc600e5aa44409ea3ce4c2861cb4de1"
format_stamp: "Formatted at 2026-06-18 19:56:58 on dist-test-slave-6zlr"
I20260618 19:57:12.156038 4173 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 19:57:12.178860 4173 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 19:57:12.179831 4173 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 19:57:12.180150 4173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 19:57:12.204008 4173 rpc_server.cc:307] RPC server started. Bound to: 127.2.158.190:41233
I20260618 19:57:12.204037 4247 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.158.190:41233 every 8 connection(s)
I20260618 19:57:12.205976 4173 server_base.cc:1193] Dumped server information to /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-0/data/info.pb
I20260618 19:57:12.211190 2682 external_mini_cluster.cc:1434] Started /tmp/dist-test-task_3iVrE/build/asan/bin/kudu as pid 4173
I20260618 19:57:12.213483 4248 sys_catalog.cc:263] Verifying existing consensus state
I20260618 19:57:12.216984 4248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1: Bootstrap starting.
I20260618 19:57:12.229705 4248 log.cc:826] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1: Log is configured to *not* fsync() on all Append() calls
I20260618 19:57:12.239537 3656 heartbeater.cc:344] Connected to a master server at 127.2.158.190:41233
I20260618 19:57:12.265138 4248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1: Bootstrap replayed 1/1 log segments. Stats: ops{read=37 overwritten=0 applied=36 ignored=0} inserts{seen=25 ignored=0} mutations{seen=23 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260618 19:57:12.266496 4248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1: Bootstrap complete.
I20260618 19:57:12.272004 4248 raft_consensus.cc:359] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 3 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:12.274564 4248 raft_consensus.cc:740] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: acc600e5aa44409ea3ce4c2861cb4de1, State: Initialized, Role: FOLLOWER
I20260618 19:57:12.275214 4248 consensus_queue.cc:260] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 36, Last appended: 3.37, Last appended by leader: 37, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:12.276141 4256 sys_catalog.cc:455] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:12.276508 4256 sys_catalog.cc:458] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [sys.catalog]: This master's current role is: FOLLOWER
I20260618 19:57:12.277351 4248 sys_catalog.cc:565] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 19:57:12.291877 4270 catalog_manager.cc:1294] Loaded cluster ID: 2cd457c38b944bab8903c2f58018327f
I20260618 19:57:12.292111 4270 catalog_manager.cc:1587] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1: loading cluster ID for follower catalog manager: success
I20260618 19:57:12.297536 4270 catalog_manager.cc:1609] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1: acquiring CA information for follower catalog manager: success
I20260618 19:57:12.302888 4270 catalog_manager.cc:1637] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260618 19:57:12.320684 4173 master_runner.cc:187] Error getting master registration for 127.2.158.189:45955: Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111),
I20260618 19:57:12.326296 4173 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260618 19:57:12.589917 3373 heartbeater.cc:344] Connected to a master server at 127.2.158.190:41233
I20260618 19:57:12.592857 4213 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" instance_seqno: 1781812621349212) as {username='slave'} at 127.2.158.129:58255; Asking this server to re-register.
I20260618 19:57:12.593856 3373 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:12.595963 4213 ts_manager.cc:194] Registered new tserver with Master: 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205)
I20260618 19:57:12.626389 3512 heartbeater.cc:344] Connected to a master server at 127.2.158.190:41233
I20260618 19:57:12.628432 4213 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" instance_seqno: 1781812621902304) as {username='slave'} at 127.2.158.130:52531; Asking this server to re-register.
I20260618 19:57:12.629117 3512 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:12.630435 4213 ts_manager.cc:194] Registered new tserver with Master: 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483)
I20260618 19:57:12.632959 4279 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:12.633180 4279 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:12.633937 4279 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:57:12.638192 4052 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 19:57:12.642949 4223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c13c838eb85465090e1bff0df28912f" candidate_term: 5 candidate_status { last_received { term: 4 index: 44 } } ignore_live_leader: false dest_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" is_pre_election: true
I20260618 19:57:12.643599 4223 raft_consensus.cc:2468] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c13c838eb85465090e1bff0df28912f in term 3.
I20260618 19:57:12.644349 4050 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f, acc600e5aa44409ea3ce4c2861cb4de1; no voters: 0447960184714aaf886ca15b9aa0e63a
I20260618 19:57:12.644845 4279 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260618 19:57:12.644961 4279 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 19:57:12.645056 4279 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 4 FOLLOWER]: Advancing to term 5
I20260618 19:57:12.649948 4279 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:12.650667 4279 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 election: Requested vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
I20260618 19:57:12.651666 4223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c13c838eb85465090e1bff0df28912f" candidate_term: 5 candidate_status { last_received { term: 4 index: 44 } } ignore_live_leader: false dest_uuid: "acc600e5aa44409ea3ce4c2861cb4de1"
I20260618 19:57:12.651860 4223 raft_consensus.cc:3060] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 3 FOLLOWER]: Advancing to term 5
W20260618 19:57:12.652454 4052 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 19:57:12.656702 4223 raft_consensus.cc:2468] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c13c838eb85465090e1bff0df28912f in term 5.
I20260618 19:57:12.657310 4050 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f, acc600e5aa44409ea3ce4c2861cb4de1; no voters: 0447960184714aaf886ca15b9aa0e63a
I20260618 19:57:12.657670 4279 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 5 FOLLOWER]: Leader election won for term 5
I20260618 19:57:12.658209 4279 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 5 LEADER]: Becoming Leader. State: Replica: 6c13c838eb85465090e1bff0df28912f, State: Running, Role: LEADER
I20260618 19:57:12.658701 4279 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 44, Committed index: 44, Last appended: 4.44, Last appended by leader: 44, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:12.661604 4283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c13c838eb85465090e1bff0df28912f. Latest consensus state: current_term: 5 leader_uuid: "6c13c838eb85465090e1bff0df28912f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:12.661945 4283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: This master's current role is: LEADER
I20260618 19:57:12.663435 4285 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260618 19:57:12.667317 4285 catalog_manager.cc:679] Loaded metadata for table default.table_28d033357fdb4b29b0abfeebb5ef122b [id=58a0cd369a884f1fb371a75c1794f738]
I20260618 19:57:12.668020 4285 catalog_manager.cc:679] Loaded metadata for table default.table_e1e6b231bd514a58a66b66d04eff6e48 [id=5a73fe372e7f47b49ed9219558f0194e]
I20260618 19:57:12.668423 4285 catalog_manager.cc:679] Loaded metadata for table default.table_4957212a0ca5452e98630b441906262f [id=749b241f59b34125a9ff8d7c847ddd3d]
I20260618 19:57:12.668857 4285 catalog_manager.cc:679] Loaded metadata for table default.table_4f9cd241b4284c4796f2aba3ccec0e35 [id=873b29232cab4ad9a9f8c070455c98a9]
I20260618 19:57:12.669301 4285 catalog_manager.cc:679] Loaded metadata for table default.table_77c95317631d4b1eab1943139e888ecb [id=aca591adc1fb402ca2dcd58765479d54]
I20260618 19:57:12.669785 4285 catalog_manager.cc:679] Loaded metadata for table default.table_b11e5cb8e5194655b89a8452d2eb25f5 [id=b3a217a305294496bd2ad3d3eed4e179]
I20260618 19:57:12.670202 4285 catalog_manager.cc:679] Loaded metadata for table default.table_8a3fffa237bc419e8921a2b75f70e639 [id=c256b56cd126492ea4f98f7d075e0a53]
I20260618 19:57:12.670717 4285 catalog_manager.cc:679] Loaded metadata for table default.table_736a38f9f9fe4dc7aed9092c9b7b33cb [id=e0eb4bb31ccb4cb58174534059e2ce81]
I20260618 19:57:12.671115 4285 catalog_manager.cc:679] Loaded metadata for table default.table_39c8f72f53c5475bb66b72b21bd13991 [id=e13d5a8056214b30b410b665b7184922]
I20260618 19:57:12.673482 4285 tablet_loader.cc:96] loaded metadata for tablet 48c932d095ea475abc03d02def7e9a27 (table default.table_28d033357fdb4b29b0abfeebb5ef122b [id=58a0cd369a884f1fb371a75c1794f738])
I20260618 19:57:12.673833 4285 tablet_loader.cc:96] loaded metadata for tablet 59b33f9c5c494332a5892a1a1ef9672d (table default.table_4957212a0ca5452e98630b441906262f [id=749b241f59b34125a9ff8d7c847ddd3d])
I20260618 19:57:12.674324 4285 tablet_loader.cc:96] loaded metadata for tablet 6dd4cd01d8e94363bec5d2897941d94a (table default.table_8a3fffa237bc419e8921a2b75f70e639 [id=c256b56cd126492ea4f98f7d075e0a53])
I20260618 19:57:12.674623 4285 tablet_loader.cc:96] loaded metadata for tablet 729a419e001f43b681075130b9543835 (table default.table_e1e6b231bd514a58a66b66d04eff6e48 [id=5a73fe372e7f47b49ed9219558f0194e])
I20260618 19:57:12.674939 4285 tablet_loader.cc:96] loaded metadata for tablet 8dd15a7fb224481593155899a99c249c (table default.table_39c8f72f53c5475bb66b72b21bd13991 [id=e13d5a8056214b30b410b665b7184922])
I20260618 19:57:12.675215 4285 tablet_loader.cc:96] loaded metadata for tablet 99a740f6744048c98e87c484ee2b492b (table default.table_736a38f9f9fe4dc7aed9092c9b7b33cb [id=e0eb4bb31ccb4cb58174534059e2ce81])
I20260618 19:57:12.675662 4285 tablet_loader.cc:96] loaded metadata for tablet ac559ee42eb645058582d38f4ed0e4db (table default.table_77c95317631d4b1eab1943139e888ecb [id=aca591adc1fb402ca2dcd58765479d54])
I20260618 19:57:12.676110 4285 tablet_loader.cc:96] loaded metadata for tablet bce5543840af43b7b9933eb585ceeb80 (table default.table_b11e5cb8e5194655b89a8452d2eb25f5 [id=b3a217a305294496bd2ad3d3eed4e179])
I20260618 19:57:12.676712 4285 tablet_loader.cc:96] loaded metadata for tablet f45d6e214bb646cdbf84ee1572859863 (table default.table_4f9cd241b4284c4796f2aba3ccec0e35 [id=873b29232cab4ad9a9f8c070455c98a9])
I20260618 19:57:12.677207 4285 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260618 19:57:12.678236 4285 catalog_manager.cc:1294] Loaded cluster ID: 2cd457c38b944bab8903c2f58018327f
I20260618 19:57:12.678309 4285 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260618 19:57:12.680181 4285 catalog_manager.cc:1539] Loading token signing keys...
I20260618 19:57:12.681594 4285 catalog_manager.cc:6080] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: Loaded TSK: 0
I20260618 19:57:12.682544 4285 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260618 19:57:12.683513 4285 catalog_manager.cc:1562] Loading latest processed Hive Metastore notification log event ID...
I20260618 19:57:12.684501 4285 catalog_manager.cc:5918] Last processed Hive Metastore notification event ID: -1
I20260618 19:57:12.745208 4213 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" instance_seqno: 1781812622463911) as {username='slave'} at 127.2.158.131:47311; Asking this server to re-register.
I20260618 19:57:12.746228 3656 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:12.747614 4213 ts_manager.cc:194] Registered new tserver with Master: 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:12.766248 4065 master_service.cc:960] ReplaceTablet: received request to replace tablet 6dd4cd01d8e94363bec5d2897941d94a from {username='slave'} at 127.0.0.1:38652
I20260618 19:57:12.767170 4061 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38652:
table { table_name: "default.Table_e1e6b231bd514a58a66b66d04eff6e48" } new_table_name: "default.Table_796d5677d78149a99894d70ce226919d" modify_external_catalogs: true
I20260618 19:57:12.768086 4057 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38652:
table { table_name: "default.Table_4957212a0ca5452e98630b441906262f" } new_table_name: "default.Table_972741ac692e4b0797a3406e734bb4d4" modify_external_catalogs: true
I20260618 19:57:12.768229 4066 master_service.cc:960] ReplaceTablet: received request to replace tablet ac559ee42eb645058582d38f4ed0e4db from {username='slave'} at 127.0.0.1:38652
I20260618 19:57:12.769956 4059 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38652:
table { table_name: "default.Table_4f9cd241b4284c4796f2aba3ccec0e35" } new_table_name: "default.Table_09ffd657f7864eb4a23acb264281460c" modify_external_catalogs: true
I20260618 19:57:12.770452 4062 master_service.cc:960] ReplaceTablet: received request to replace tablet 99a740f6744048c98e87c484ee2b492b from {username='slave'} at 127.0.0.1:38652
I20260618 19:57:12.770349 4060 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38652:
name: "default.Table_0711d10accfd429788e8e459cacc6139"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:12.771559 4058 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38652:
table { table_name: "default.Table_b11e5cb8e5194655b89a8452d2eb25f5" } new_table_name: "default.Table_9fbf373ce2cc4af6949381c591b56ca1" modify_external_catalogs: true
I20260618 19:57:12.769505 4064 master_service.cc:960] ReplaceTablet: received request to replace tablet 59b33f9c5c494332a5892a1a1ef9672d from {username='slave'} at 127.0.0.1:38652
I20260618 19:57:12.772677 4063 master_service.cc:960] ReplaceTablet: received request to replace tablet 99a740f6744048c98e87c484ee2b492b from {username='slave'} at 127.0.0.1:38652
I20260618 19:57:12.778525 4223 raft_consensus.cc:1275] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 5 FOLLOWER]: Refusing update from remote peer 6c13c838eb85465090e1bff0df28912f: Log matching property violated. Preceding OpId in replica: term: 3 index: 37. Preceding OpId from leader: term: 5 index: 46. (index mismatch)
W20260618 19:57:12.779505 4052 consensus_peers.cc:597] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f -> Peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Couldn't send request to peer 0447960184714aaf886ca15b9aa0e63a. Status: Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260618 19:57:12.779553 4283 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [LEADER]: Connected to new peer: Peer: permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 45, Last known committed idx: 36, Time since last communication: 0.000s
F20260618 19:57:12.781051 4119 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 1, previous 1; dumping first 2 out of 10 received events: NotificationEvent(eventId=1, eventTime=1781812622, eventType=CREATE_TABLE, dbName=default, tableName=table_402627eeff7b4c338e64cfbe575411be, message={"server":"","servicePrincipal":"","db":"default","table":"table_402627eeff7b4c338e64cfbe575411be","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_402627eeff7b4c338e64cfbe575411be\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1781812622},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/warehouse/table_402627eeff7b4c338e64cfbe575411be\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_402627eeff7b4c338e64cfbe575411be\",\"kudu.table_id\":\"d0b8f5d092934582ab6ebf43cd6f9f6f\",\"transient_lastDdlTime\":\"1781812622\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"2cd457c38b944bab8903c2f58018327f\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1781812622,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=1, eventTime=1781812622, eventType=CREATE_TABLE, dbName=default, tableName=table_4957212a0ca5452e98630b441906262f, message={"server":"","servicePrincipal":"","db":"default","table":"table_4957212a0ca5452e98630b441906262f","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_4957212a0ca5452e98630b441906262f\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1781812622},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/warehouse/table_4957212a0ca5452e98630b441906262f\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_4957212a0ca5452e98630b441906262f\",\"kudu.table_id\":\"749b241f59b34125a9ff8d7c847ddd3d\",\"transient_lastDdlTime\":\"1781812622\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"2cd457c38b944bab8903c2f58018327f\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1781812622,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7fb74ea31dcd google::LogMessage::Fail() at ??:0
@ 0x7fb74ea35b93 google::LogMessage::SendToLog() at ??:0
@ 0x7fb74ea317cc google::LogMessage::Flush() at ??:0
@ 0x7fb74ea31a11 google::LogMessage::~LogMessage() at ??:0
I20260618 19:57:12.796701 4293 sys_catalog.cc:455] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "6c13c838eb85465090e1bff0df28912f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:12.796993 4293 sys_catalog.cc:458] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7fb76562c394 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260618 19:57:12.797685 4288 sys_catalog.cc:455] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c13c838eb85465090e1bff0df28912f. Latest consensus state: current_term: 5 leader_uuid: "6c13c838eb85465090e1bff0df28912f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:12.798036 4288 sys_catalog.cc:458] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [sys.catalog]: This master's current role is: FOLLOWER
I20260618 19:57:12.802343 4287 mvcc.cc:204] Tried to move back new op lower bound from 7298304543849263104 to 7298304543373983744. Current Snapshot: MvccSnapshot[applied={T|T < 7298304543849263104}]
I20260618 19:57:12.803211 4288 sys_catalog.cc:455] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "6c13c838eb85465090e1bff0df28912f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:12.803474 4288 sys_catalog.cc:458] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [sys.catalog]: This master's current role is: FOLLOWER
I20260618 19:57:12.807111 4066 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: Sending DeleteTablet for 3 replicas of tablet ac559ee42eb645058582d38f4ed0e4db
I20260618 19:57:12.810768 4066 catalog_manager.cc:6784] ReplaceTablet: tablet ac559ee42eb645058582d38f4ed0e4db deleted and replaced by tablet 42b5d60c1e3e4323866ddd8e5b8881b6
@ 0x7fb76562ac41 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260618 19:57:12.819224 4062 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: Sending DeleteTablet for 3 replicas of tablet 99a740f6744048c98e87c484ee2b492b
I20260618 19:57:12.819916 4062 catalog_manager.cc:6784] ReplaceTablet: tablet 99a740f6744048c98e87c484ee2b492b deleted and replaced by tablet 15e541a8d092404eb2b2920893b94da3
I20260618 19:57:12.824319 4062 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38652:
name: "default.Table_0975ad87638142ddbb8e4438fc9393a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:12.825042 4066 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38652:
name: "default.Table_b536ea4ed5c945adb98d4d2c41448d70"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:12.825136 4063 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38652:
table { table_name: "default.Table_39c8f72f53c5475bb66b72b21bd13991" } new_table_name: "default.Table_90f63258f4774ae884662efcb6a64fc3" modify_external_catalogs: true
I20260618 19:57:12.825611 4283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "6c13c838eb85465090e1bff0df28912f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:12.825879 4283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: This master's current role is: LEADER
I20260618 19:57:12.828159 4064 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: Sending DeleteTablet for 3 replicas of tablet 59b33f9c5c494332a5892a1a1ef9672d
I20260618 19:57:12.828266 4065 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: Sending DeleteTablet for 3 replicas of tablet 6dd4cd01d8e94363bec5d2897941d94a
I20260618 19:57:12.828879 4065 catalog_manager.cc:6784] ReplaceTablet: tablet 6dd4cd01d8e94363bec5d2897941d94a deleted and replaced by tablet 182415f6a2c94b9fa32ae241aced8853
I20260618 19:57:12.829402 4065 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38652:
name: "default.Table_9557e658e4484fffa051fe4e630478d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
@ 0x7fb7656328bc kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260618 19:57:12.833190 4064 catalog_manager.cc:6784] ReplaceTablet: tablet 59b33f9c5c494332a5892a1a1ef9672d deleted and replaced by tablet 83164978e2724f98ac65581b775089b9
I20260618 19:57:12.833709 4064 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38652:
name: "default.Table_fa143415606c44cf80647e88be53822a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
@ 0x7fb765632739 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa681d std::function<>::operator()() at ??:?
@ 0x7fb751758f49 kudu::Thread::SuperviseThread() at ??:0
I20260618 19:57:12.845829 3307 tablet_service.cc:1558] Processing DeleteTablet for tablet ac559ee42eb645058582d38f4ed0e4db with delete_type TABLET_DATA_DELETED (replaced by tablet 42b5d60c1e3e4323866ddd8e5b8881b6) from {username='slave'} at 127.0.0.1:37810
I20260618 19:57:12.846081 3308 tablet_service.cc:1558] Processing DeleteTablet for tablet 99a740f6744048c98e87c484ee2b492b with delete_type TABLET_DATA_DELETED (replaced by tablet 15e541a8d092404eb2b2920893b94da3) from {username='slave'} at 127.0.0.1:37810
I20260618 19:57:12.846309 3306 tablet_service.cc:1558] Processing DeleteTablet for tablet 59b33f9c5c494332a5892a1a1ef9672d with delete_type TABLET_DATA_DELETED (replaced by tablet 83164978e2724f98ac65581b775089b9) from {username='slave'} at 127.0.0.1:37810
I20260618 19:57:12.846524 3305 tablet_service.cc:1558] Processing DeleteTablet for tablet 6dd4cd01d8e94363bec5d2897941d94a with delete_type TABLET_DATA_DELETED (replaced by tablet 182415f6a2c94b9fa32ae241aced8853) from {username='slave'} at 127.0.0.1:37810
I20260618 19:57:12.858212 3305 tablet_service.cc:1511] Processing CreateTablet for tablet 15e541a8d092404eb2b2920893b94da3 (DEFAULT_TABLE table=default.table_736a38f9f9fe4dc7aed9092c9b7b33cb [id=e0eb4bb31ccb4cb58174534059e2ce81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:12.858878 3305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e541a8d092404eb2b2920893b94da3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:12.862553 4291 mvcc.cc:204] Tried to move back new op lower bound from 7298304543860817920 to 7298304512813658112. Current Snapshot: MvccSnapshot[applied={T|T < 7298304543860817920 or (T in {7298304543860817920})}]
I20260618 19:57:12.864595 3306 tablet_service.cc:1511] Processing CreateTablet for tablet 42b5d60c1e3e4323866ddd8e5b8881b6 (DEFAULT_TABLE table=default.table_77c95317631d4b1eab1943139e888ecb [id=aca591adc1fb402ca2dcd58765479d54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:12.864988 3306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42b5d60c1e3e4323866ddd8e5b8881b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:12.867751 3308 tablet_service.cc:1511] Processing CreateTablet for tablet 83164978e2724f98ac65581b775089b9 (DEFAULT_TABLE table=default.table_4957212a0ca5452e98630b441906262f [id=749b241f59b34125a9ff8d7c847ddd3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:12.868140 3308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83164978e2724f98ac65581b775089b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:12.870070 3447 tablet_service.cc:1558] Processing DeleteTablet for tablet ac559ee42eb645058582d38f4ed0e4db with delete_type TABLET_DATA_DELETED (replaced by tablet 42b5d60c1e3e4323866ddd8e5b8881b6) from {username='slave'} at 127.0.0.1:53668
@ 0x7fb754e226db start_thread at ??:0
I20260618 19:57:12.872294 3445 tablet_service.cc:1558] Processing DeleteTablet for tablet 99a740f6744048c98e87c484ee2b492b with delete_type TABLET_DATA_DELETED (replaced by tablet 15e541a8d092404eb2b2920893b94da3) from {username='slave'} at 127.0.0.1:53668
I20260618 19:57:12.872922 3445 tablet_service.cc:1558] Processing DeleteTablet for tablet 59b33f9c5c494332a5892a1a1ef9672d with delete_type TABLET_DATA_DELETED (replaced by tablet 83164978e2724f98ac65581b775089b9) from {username='slave'} at 127.0.0.1:53668
I20260618 19:57:12.873417 3445 tablet_service.cc:1558] Processing DeleteTablet for tablet 6dd4cd01d8e94363bec5d2897941d94a with delete_type TABLET_DATA_DELETED (replaced by tablet 182415f6a2c94b9fa32ae241aced8853) from {username='slave'} at 127.0.0.1:53668
I20260618 19:57:12.874117 3445 tablet_service.cc:1511] Processing CreateTablet for tablet 15e541a8d092404eb2b2920893b94da3 (DEFAULT_TABLE table=default.table_736a38f9f9fe4dc7aed9092c9b7b33cb [id=e0eb4bb31ccb4cb58174534059e2ce81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:12.874465 3445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e541a8d092404eb2b2920893b94da3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:12.877143 3306 tablet_service.cc:1511] Processing CreateTablet for tablet 182415f6a2c94b9fa32ae241aced8853 (DEFAULT_TABLE table=default.table_8a3fffa237bc419e8921a2b75f70e639 [id=c256b56cd126492ea4f98f7d075e0a53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:12.877471 4308 tablet_replica.cc:333] T ac559ee42eb645058582d38f4ed0e4db P 722df47a60ca4bfa82104dea57718f3b: stopping tablet replica
I20260618 19:57:12.877540 3306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 182415f6a2c94b9fa32ae241aced8853. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:12.877661 4308 raft_consensus.cc:2243] T ac559ee42eb645058582d38f4ed0e4db P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Raft consensus shutting down.
@ 0x7fb74d8e061f clone at ??:0
I20260618 19:57:12.877887 4308 raft_consensus.cc:2272] T ac559ee42eb645058582d38f4ed0e4db P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:12.878873 4308 ts_tablet_manager.cc:1916] T ac559ee42eb645058582d38f4ed0e4db P 722df47a60ca4bfa82104dea57718f3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:12.881173 4305 tablet_replica.cc:333] T ac559ee42eb645058582d38f4ed0e4db P 51c7777f264b496a9bf9511966dcfbd7: stopping tablet replica
I20260618 19:57:12.881232 3590 tablet_service.cc:1558] Processing DeleteTablet for tablet ac559ee42eb645058582d38f4ed0e4db with delete_type TABLET_DATA_DELETED (replaced by tablet 42b5d60c1e3e4323866ddd8e5b8881b6) from {username='slave'} at 127.0.0.1:44032
I20260618 19:57:12.881386 4305 raft_consensus.cc:2243] T ac559ee42eb645058582d38f4ed0e4db P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 19:57:12.881611 4305 raft_consensus.cc:2272] T ac559ee42eb645058582d38f4ed0e4db P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:12.881798 3447 tablet_service.cc:1511] Processing CreateTablet for tablet 42b5d60c1e3e4323866ddd8e5b8881b6 (DEFAULT_TABLE table=default.table_77c95317631d4b1eab1943139e888ecb [id=aca591adc1fb402ca2dcd58765479d54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:12.882141 4305 ts_tablet_manager.cc:1916] T ac559ee42eb645058582d38f4ed0e4db P 51c7777f264b496a9bf9511966dcfbd7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:12.882330 3447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42b5d60c1e3e4323866ddd8e5b8881b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:12.883018 3589 tablet_service.cc:1558] Processing DeleteTablet for tablet 99a740f6744048c98e87c484ee2b492b with delete_type TABLET_DATA_DELETED (replaced by tablet 15e541a8d092404eb2b2920893b94da3) from {username='slave'} at 127.0.0.1:44032
I20260618 19:57:12.883380 3591 tablet_service.cc:1558] Processing DeleteTablet for tablet 6dd4cd01d8e94363bec5d2897941d94a with delete_type TABLET_DATA_DELETED (replaced by tablet 182415f6a2c94b9fa32ae241aced8853) from {username='slave'} at 127.0.0.1:44032
I20260618 19:57:12.883800 3591 tablet_service.cc:1558] Processing DeleteTablet for tablet 59b33f9c5c494332a5892a1a1ef9672d with delete_type TABLET_DATA_DELETED (replaced by tablet 83164978e2724f98ac65581b775089b9) from {username='slave'} at 127.0.0.1:44032
I20260618 19:57:12.884435 3591 tablet_service.cc:1511] Processing CreateTablet for tablet 15e541a8d092404eb2b2920893b94da3 (DEFAULT_TABLE table=default.table_736a38f9f9fe4dc7aed9092c9b7b33cb [id=e0eb4bb31ccb4cb58174534059e2ce81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:12.884833 3591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e541a8d092404eb2b2920893b94da3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:12.885833 3444 tablet_service.cc:1511] Processing CreateTablet for tablet 83164978e2724f98ac65581b775089b9 (DEFAULT_TABLE table=default.table_4957212a0ca5452e98630b441906262f [id=749b241f59b34125a9ff8d7c847ddd3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:12.886325 3446 tablet_service.cc:1511] Processing CreateTablet for tablet 182415f6a2c94b9fa32ae241aced8853 (DEFAULT_TABLE table=default.table_8a3fffa237bc419e8921a2b75f70e639 [id=c256b56cd126492ea4f98f7d075e0a53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:12.886335 3444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83164978e2724f98ac65581b775089b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:12.888434 4305 ts_tablet_manager.cc:1929] T ac559ee42eb645058582d38f4ed0e4db P 51c7777f264b496a9bf9511966dcfbd7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:12.888571 4305 log.cc:1199] T ac559ee42eb645058582d38f4ed0e4db P 51c7777f264b496a9bf9511966dcfbd7: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-0/wal/wals/ac559ee42eb645058582d38f4ed0e4db
I20260618 19:57:12.889082 4305 ts_tablet_manager.cc:1950] T ac559ee42eb645058582d38f4ed0e4db P 51c7777f264b496a9bf9511966dcfbd7: Deleting consensus metadata
I20260618 19:57:12.889817 3589 tablet_service.cc:1511] Processing CreateTablet for tablet 42b5d60c1e3e4323866ddd8e5b8881b6 (DEFAULT_TABLE table=default.table_77c95317631d4b1eab1943139e888ecb [id=aca591adc1fb402ca2dcd58765479d54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:12.890084 4305 tablet_replica.cc:333] T 99a740f6744048c98e87c484ee2b492b P 51c7777f264b496a9bf9511966dcfbd7: stopping tablet replica
I20260618 19:57:12.890226 3589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42b5d60c1e3e4323866ddd8e5b8881b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:12.890295 4305 raft_consensus.cc:2243] T 99a740f6744048c98e87c484ee2b492b P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 19:57:12.890468 4305 raft_consensus.cc:2272] T 99a740f6744048c98e87c484ee2b492b P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:12.890997 4305 ts_tablet_manager.cc:1916] T 99a740f6744048c98e87c484ee2b492b P 51c7777f264b496a9bf9511966dcfbd7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:12.892649 3446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 182415f6a2c94b9fa32ae241aced8853. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:12.885856 4308 ts_tablet_manager.cc:1929] T ac559ee42eb645058582d38f4ed0e4db P 722df47a60ca4bfa82104dea57718f3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:12.893441 4308 log.cc:1199] T ac559ee42eb645058582d38f4ed0e4db P 722df47a60ca4bfa82104dea57718f3b: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-1/wal/wals/ac559ee42eb645058582d38f4ed0e4db
I20260618 19:57:12.893930 4308 ts_tablet_manager.cc:1950] T ac559ee42eb645058582d38f4ed0e4db P 722df47a60ca4bfa82104dea57718f3b: Deleting consensus metadata
I20260618 19:57:12.894973 4308 tablet_replica.cc:333] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b: stopping tablet replica
I20260618 19:57:12.895171 4308 raft_consensus.cc:2243] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b [term 1 LEADER]: Raft consensus shutting down.
I20260618 19:57:12.895486 4308 raft_consensus.cc:2272] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:12.896616 4311 tablet_bootstrap.cc:492] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Bootstrap starting.
I20260618 19:57:12.897662 4308 ts_tablet_manager.cc:1916] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:12.898514 4305 ts_tablet_manager.cc:1929] T 99a740f6744048c98e87c484ee2b492b P 51c7777f264b496a9bf9511966dcfbd7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:12.898636 4305 log.cc:1199] T 99a740f6744048c98e87c484ee2b492b P 51c7777f264b496a9bf9511966dcfbd7: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-0/wal/wals/99a740f6744048c98e87c484ee2b492b
I20260618 19:57:12.898711 3588 tablet_service.cc:1511] Processing CreateTablet for tablet 83164978e2724f98ac65581b775089b9 (DEFAULT_TABLE table=default.table_4957212a0ca5452e98630b441906262f [id=749b241f59b34125a9ff8d7c847ddd3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:12.899025 4305 ts_tablet_manager.cc:1950] T 99a740f6744048c98e87c484ee2b492b P 51c7777f264b496a9bf9511966dcfbd7: Deleting consensus metadata
I20260618 19:57:12.899122 3588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83164978e2724f98ac65581b775089b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:12.899920 4305 tablet_replica.cc:333] T 59b33f9c5c494332a5892a1a1ef9672d P 51c7777f264b496a9bf9511966dcfbd7: stopping tablet replica
I20260618 19:57:12.900079 4305 raft_consensus.cc:2243] T 59b33f9c5c494332a5892a1a1ef9672d P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 19:57:12.900233 4305 raft_consensus.cc:2272] T 59b33f9c5c494332a5892a1a1ef9672d P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:12.900743 4305 ts_tablet_manager.cc:1916] T 59b33f9c5c494332a5892a1a1ef9672d P 51c7777f264b496a9bf9511966dcfbd7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:12.901592 4310 tablet_bootstrap.cc:492] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 722df47a60ca4bfa82104dea57718f3b: Bootstrap starting.
I20260618 19:57:12.903409 4310 tablet_bootstrap.cc:654] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 722df47a60ca4bfa82104dea57718f3b: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:12.905906 4311 tablet_bootstrap.cc:654] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:12.906711 4305 ts_tablet_manager.cc:1929] T 59b33f9c5c494332a5892a1a1ef9672d P 51c7777f264b496a9bf9511966dcfbd7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:12.906836 4305 log.cc:1199] T 59b33f9c5c494332a5892a1a1ef9672d P 51c7777f264b496a9bf9511966dcfbd7: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-0/wal/wals/59b33f9c5c494332a5892a1a1ef9672d
I20260618 19:57:12.907267 4305 ts_tablet_manager.cc:1950] T 59b33f9c5c494332a5892a1a1ef9672d P 51c7777f264b496a9bf9511966dcfbd7: Deleting consensus metadata
I20260618 19:57:12.908237 4305 tablet_replica.cc:333] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7: stopping tablet replica
I20260618 19:57:12.908329 4310 tablet_bootstrap.cc:492] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 722df47a60ca4bfa82104dea57718f3b: No bootstrap required, opened a new log
I20260618 19:57:12.908452 4310 ts_tablet_manager.cc:1403] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 722df47a60ca4bfa82104dea57718f3b: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260618 19:57:12.908440 4305 raft_consensus.cc:2243] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7 [term 1 LEADER]: Raft consensus shutting down.
I20260618 19:57:12.908602 3588 tablet_service.cc:1511] Processing CreateTablet for tablet 182415f6a2c94b9fa32ae241aced8853 (DEFAULT_TABLE table=default.table_8a3fffa237bc419e8921a2b75f70e639 [id=c256b56cd126492ea4f98f7d075e0a53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 19:57:12.908954 4305 raft_consensus.cc:2272] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:12.909003 3588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 182415f6a2c94b9fa32ae241aced8853. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 19:57:12.909229 4310 raft_consensus.cc:359] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:12.909451 4310 raft_consensus.cc:385] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:12.909536 4310 raft_consensus.cc:740] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 722df47a60ca4bfa82104dea57718f3b, State: Initialized, Role: FOLLOWER
I20260618 19:57:12.909554 4305 ts_tablet_manager.cc:1916] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:12.912091 4308 ts_tablet_manager.cc:1929] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:12.912209 4308 log.cc:1199] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-1/wal/wals/99a740f6744048c98e87c484ee2b492b
I20260618 19:57:12.912600 4308 ts_tablet_manager.cc:1950] T 99a740f6744048c98e87c484ee2b492b P 722df47a60ca4bfa82104dea57718f3b: Deleting consensus metadata
I20260618 19:57:12.913412 4310 consensus_queue.cc:260] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 722df47a60ca4bfa82104dea57718f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:12.915338 4305 ts_tablet_manager.cc:1929] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:12.915477 4305 log.cc:1199] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-0/wal/wals/6dd4cd01d8e94363bec5d2897941d94a
I20260618 19:57:12.916240 4305 ts_tablet_manager.cc:1950] T 6dd4cd01d8e94363bec5d2897941d94a P 51c7777f264b496a9bf9511966dcfbd7: Deleting consensus metadata
I20260618 19:57:12.917997 4310 ts_tablet_manager.cc:1434] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 722df47a60ca4bfa82104dea57718f3b: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260618 19:57:12.918332 4308 tablet_replica.cc:333] T 59b33f9c5c494332a5892a1a1ef9672d P 722df47a60ca4bfa82104dea57718f3b: stopping tablet replica
I20260618 19:57:12.918519 4308 raft_consensus.cc:2243] T 59b33f9c5c494332a5892a1a1ef9672d P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 19:57:12.918718 4308 raft_consensus.cc:2272] T 59b33f9c5c494332a5892a1a1ef9672d P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:12.919281 4308 ts_tablet_manager.cc:1916] T 59b33f9c5c494332a5892a1a1ef9672d P 722df47a60ca4bfa82104dea57718f3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:12.926669 4308 ts_tablet_manager.cc:1929] T 59b33f9c5c494332a5892a1a1ef9672d P 722df47a60ca4bfa82104dea57718f3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:12.926796 4308 log.cc:1199] T 59b33f9c5c494332a5892a1a1ef9672d P 722df47a60ca4bfa82104dea57718f3b: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-1/wal/wals/59b33f9c5c494332a5892a1a1ef9672d
I20260618 19:57:12.927263 4308 ts_tablet_manager.cc:1950] T 59b33f9c5c494332a5892a1a1ef9672d P 722df47a60ca4bfa82104dea57718f3b: Deleting consensus metadata
I20260618 19:57:12.928479 4308 tablet_replica.cc:333] T 6dd4cd01d8e94363bec5d2897941d94a P 722df47a60ca4bfa82104dea57718f3b: stopping tablet replica
I20260618 19:57:12.928709 4308 raft_consensus.cc:2243] T 6dd4cd01d8e94363bec5d2897941d94a P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 19:57:12.928887 4308 raft_consensus.cc:2272] T 6dd4cd01d8e94363bec5d2897941d94a P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:12.929498 4308 ts_tablet_manager.cc:1916] T 6dd4cd01d8e94363bec5d2897941d94a P 722df47a60ca4bfa82104dea57718f3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:12.931350 4309 tablet_replica.cc:333] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1: stopping tablet replica
I20260618 19:57:12.931538 4309 raft_consensus.cc:2243] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 LEADER]: Raft consensus shutting down.
I20260618 19:57:12.931939 4309 raft_consensus.cc:2272] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:12.932497 4309 ts_tablet_manager.cc:1916] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:12.934042 4307 tablet_bootstrap.cc:492] T 15e541a8d092404eb2b2920893b94da3 P 51c7777f264b496a9bf9511966dcfbd7: Bootstrap starting.
I20260618 19:57:12.936069 4307 tablet_bootstrap.cc:654] T 15e541a8d092404eb2b2920893b94da3 P 51c7777f264b496a9bf9511966dcfbd7: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:12.937047 4308 ts_tablet_manager.cc:1929] T 6dd4cd01d8e94363bec5d2897941d94a P 722df47a60ca4bfa82104dea57718f3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:12.937239 4308 log.cc:1199] T 6dd4cd01d8e94363bec5d2897941d94a P 722df47a60ca4bfa82104dea57718f3b: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-1/wal/wals/6dd4cd01d8e94363bec5d2897941d94a
I20260618 19:57:12.937736 4308 ts_tablet_manager.cc:1950] T 6dd4cd01d8e94363bec5d2897941d94a P 722df47a60ca4bfa82104dea57718f3b: Deleting consensus metadata
I20260618 19:57:12.939879 4311 tablet_bootstrap.cc:492] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: No bootstrap required, opened a new log
I20260618 19:57:12.940034 4311 ts_tablet_manager.cc:1403] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.002s
I20260618 19:57:12.940474 4310 tablet_bootstrap.cc:492] T 15e541a8d092404eb2b2920893b94da3 P 722df47a60ca4bfa82104dea57718f3b: Bootstrap starting.
I20260618 19:57:12.942615 4310 tablet_bootstrap.cc:654] T 15e541a8d092404eb2b2920893b94da3 P 722df47a60ca4bfa82104dea57718f3b: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:12.944768 4311 raft_consensus.cc:359] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:12.944955 4311 raft_consensus.cc:385] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:12.945034 4311 raft_consensus.cc:740] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb3ca8239f4412fb8b0e7d0df9e50c1, State: Initialized, Role: FOLLOWER
I20260618 19:57:12.945309 4311 consensus_queue.cc:260] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:12.945734 3657 heartbeater.cc:499] Master 127.2.158.188:34975 was elected leader, sending a full tablet report...
I20260618 19:57:12.949436 4311 ts_tablet_manager.cc:1434] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260618 19:57:12.951901 4311 tablet_bootstrap.cc:492] T 15e541a8d092404eb2b2920893b94da3 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Bootstrap starting.
I20260618 19:57:12.953531 4311 tablet_bootstrap.cc:654] T 15e541a8d092404eb2b2920893b94da3 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:12.955382 4307 tablet_bootstrap.cc:492] T 15e541a8d092404eb2b2920893b94da3 P 51c7777f264b496a9bf9511966dcfbd7: No bootstrap required, opened a new log
I20260618 19:57:12.955535 4307 ts_tablet_manager.cc:1403] T 15e541a8d092404eb2b2920893b94da3 P 51c7777f264b496a9bf9511966dcfbd7: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
I20260618 19:57:12.956391 4307 raft_consensus.cc:359] T 15e541a8d092404eb2b2920893b94da3 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:12.956593 4307 raft_consensus.cc:385] T 15e541a8d092404eb2b2920893b94da3 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:12.956701 4307 raft_consensus.cc:740] T 15e541a8d092404eb2b2920893b94da3 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51c7777f264b496a9bf9511966dcfbd7, State: Initialized, Role: FOLLOWER
I20260618 19:57:12.956954 4307 consensus_queue.cc:260] T 15e541a8d092404eb2b2920893b94da3 P 51c7777f264b496a9bf9511966dcfbd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:12.958400 4311 tablet_bootstrap.cc:492] T 15e541a8d092404eb2b2920893b94da3 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: No bootstrap required, opened a new log
I20260618 19:57:12.958552 4311 ts_tablet_manager.cc:1403] T 15e541a8d092404eb2b2920893b94da3 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.002s
I20260618 19:57:12.959285 4311 raft_consensus.cc:359] T 15e541a8d092404eb2b2920893b94da3 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:12.959471 4311 raft_consensus.cc:385] T 15e541a8d092404eb2b2920893b94da3 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:12.959561 4311 raft_consensus.cc:740] T 15e541a8d092404eb2b2920893b94da3 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb3ca8239f4412fb8b0e7d0df9e50c1, State: Initialized, Role: FOLLOWER
I20260618 19:57:12.959791 4311 consensus_queue.cc:260] T 15e541a8d092404eb2b2920893b94da3 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:12.960240 4311 ts_tablet_manager.cc:1434] T 15e541a8d092404eb2b2920893b94da3 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260618 19:57:12.961112 4311 tablet_bootstrap.cc:492] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Bootstrap starting.
I20260618 19:57:12.962592 4307 ts_tablet_manager.cc:1434] T 15e541a8d092404eb2b2920893b94da3 P 51c7777f264b496a9bf9511966dcfbd7: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260618 19:57:12.962919 4307 tablet_bootstrap.cc:492] T 83164978e2724f98ac65581b775089b9 P 51c7777f264b496a9bf9511966dcfbd7: Bootstrap starting.
I20260618 19:57:12.962976 4311 tablet_bootstrap.cc:654] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:12.964618 4307 tablet_bootstrap.cc:654] T 83164978e2724f98ac65581b775089b9 P 51c7777f264b496a9bf9511966dcfbd7: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:12.966217 4309 ts_tablet_manager.cc:1929] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:12.966346 4309 log.cc:1199] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/wal/wals/ac559ee42eb645058582d38f4ed0e4db
I20260618 19:57:12.966786 4309 ts_tablet_manager.cc:1950] T ac559ee42eb645058582d38f4ed0e4db P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting consensus metadata
I20260618 19:57:12.967818 4309 tablet_replica.cc:333] T 99a740f6744048c98e87c484ee2b492b P 6bb3ca8239f4412fb8b0e7d0df9e50c1: stopping tablet replica
I20260618 19:57:12.968009 4309 raft_consensus.cc:2243] T 99a740f6744048c98e87c484ee2b492b P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 19:57:12.968161 4309 raft_consensus.cc:2272] T 99a740f6744048c98e87c484ee2b492b P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:12.968716 4310 tablet_bootstrap.cc:492] T 15e541a8d092404eb2b2920893b94da3 P 722df47a60ca4bfa82104dea57718f3b: No bootstrap required, opened a new log
I20260618 19:57:12.968771 4309 ts_tablet_manager.cc:1916] T 99a740f6744048c98e87c484ee2b492b P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:12.968901 4310 ts_tablet_manager.cc:1403] T 15e541a8d092404eb2b2920893b94da3 P 722df47a60ca4bfa82104dea57718f3b: Time spent bootstrapping tablet: real 0.028s user 0.005s sys 0.012s
I20260618 19:57:12.969383 4311 tablet_bootstrap.cc:492] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: No bootstrap required, opened a new log
I20260618 19:57:12.969520 4311 ts_tablet_manager.cc:1403] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260618 19:57:12.969750 4310 raft_consensus.cc:359] T 15e541a8d092404eb2b2920893b94da3 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:12.970000 4310 raft_consensus.cc:385] T 15e541a8d092404eb2b2920893b94da3 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:12.970109 4310 raft_consensus.cc:740] T 15e541a8d092404eb2b2920893b94da3 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 722df47a60ca4bfa82104dea57718f3b, State: Initialized, Role: FOLLOWER
I20260618 19:57:12.970309 4311 raft_consensus.cc:359] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:12.970479 4311 raft_consensus.cc:385] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:12.970566 4311 raft_consensus.cc:740] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb3ca8239f4412fb8b0e7d0df9e50c1, State: Initialized, Role: FOLLOWER
I20260618 19:57:12.970476 4310 consensus_queue.cc:260] T 15e541a8d092404eb2b2920893b94da3 P 722df47a60ca4bfa82104dea57718f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:12.970778 4311 consensus_queue.cc:260] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:12.971313 4311 ts_tablet_manager.cc:1434] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260618 19:57:12.971562 4311 tablet_bootstrap.cc:492] T 182415f6a2c94b9fa32ae241aced8853 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Bootstrap starting.
I20260618 19:57:12.973245 4311 tablet_bootstrap.cc:654] T 182415f6a2c94b9fa32ae241aced8853 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:12.975523 4310 ts_tablet_manager.cc:1434] T 15e541a8d092404eb2b2920893b94da3 P 722df47a60ca4bfa82104dea57718f3b: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260618 19:57:12.975924 4310 tablet_bootstrap.cc:492] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b: Bootstrap starting.
I20260618 19:57:12.977152 4307 tablet_bootstrap.cc:492] T 83164978e2724f98ac65581b775089b9 P 51c7777f264b496a9bf9511966dcfbd7: No bootstrap required, opened a new log
I20260618 19:57:12.977339 4307 ts_tablet_manager.cc:1403] T 83164978e2724f98ac65581b775089b9 P 51c7777f264b496a9bf9511966dcfbd7: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260618 19:57:12.977982 4310 tablet_bootstrap.cc:654] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:12.978098 4307 raft_consensus.cc:359] T 83164978e2724f98ac65581b775089b9 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:12.978299 4307 raft_consensus.cc:385] T 83164978e2724f98ac65581b775089b9 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:12.978401 4307 raft_consensus.cc:740] T 83164978e2724f98ac65581b775089b9 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51c7777f264b496a9bf9511966dcfbd7, State: Initialized, Role: FOLLOWER
I20260618 19:57:12.978737 4307 consensus_queue.cc:260] T 83164978e2724f98ac65581b775089b9 P 51c7777f264b496a9bf9511966dcfbd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:12.983189 4307 ts_tablet_manager.cc:1434] T 83164978e2724f98ac65581b775089b9 P 51c7777f264b496a9bf9511966dcfbd7: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260618 19:57:12.983534 4307 tablet_bootstrap.cc:492] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 51c7777f264b496a9bf9511966dcfbd7: Bootstrap starting.
I20260618 19:57:12.985369 4307 tablet_bootstrap.cc:654] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 51c7777f264b496a9bf9511966dcfbd7: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:12.988561 4309 ts_tablet_manager.cc:1929] T 99a740f6744048c98e87c484ee2b492b P 6bb3ca8239f4412fb8b0e7d0df9e50c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:12.988701 4309 log.cc:1199] T 99a740f6744048c98e87c484ee2b492b P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/wal/wals/99a740f6744048c98e87c484ee2b492b
I20260618 19:57:12.989542 4309 ts_tablet_manager.cc:1950] T 99a740f6744048c98e87c484ee2b492b P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting consensus metadata
I20260618 19:57:12.990556 4311 tablet_bootstrap.cc:492] T 182415f6a2c94b9fa32ae241aced8853 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: No bootstrap required, opened a new log
I20260618 19:57:12.990711 4311 ts_tablet_manager.cc:1403] T 182415f6a2c94b9fa32ae241aced8853 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.003s
I20260618 19:57:12.990968 4309 tablet_replica.cc:333] T 6dd4cd01d8e94363bec5d2897941d94a P 6bb3ca8239f4412fb8b0e7d0df9e50c1: stopping tablet replica
I20260618 19:57:12.991139 4309 raft_consensus.cc:2243] T 6dd4cd01d8e94363bec5d2897941d94a P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 19:57:12.991325 4309 raft_consensus.cc:2272] T 6dd4cd01d8e94363bec5d2897941d94a P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:12.991544 4311 raft_consensus.cc:359] T 182415f6a2c94b9fa32ae241aced8853 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:12.991735 4311 raft_consensus.cc:385] T 182415f6a2c94b9fa32ae241aced8853 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:12.991811 4311 raft_consensus.cc:740] T 182415f6a2c94b9fa32ae241aced8853 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb3ca8239f4412fb8b0e7d0df9e50c1, State: Initialized, Role: FOLLOWER
I20260618 19:57:12.991866 4309 ts_tablet_manager.cc:1916] T 6dd4cd01d8e94363bec5d2897941d94a P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:12.992051 4311 consensus_queue.cc:260] T 182415f6a2c94b9fa32ae241aced8853 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:12.992566 4311 ts_tablet_manager.cc:1434] T 182415f6a2c94b9fa32ae241aced8853 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260618 19:57:12.994557 4307 tablet_bootstrap.cc:492] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 51c7777f264b496a9bf9511966dcfbd7: No bootstrap required, opened a new log
I20260618 19:57:12.994700 4307 ts_tablet_manager.cc:1403] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 51c7777f264b496a9bf9511966dcfbd7: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.003s
I20260618 19:57:12.996243 4307 raft_consensus.cc:359] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:12.996423 4307 raft_consensus.cc:385] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:12.996500 4307 raft_consensus.cc:740] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51c7777f264b496a9bf9511966dcfbd7, State: Initialized, Role: FOLLOWER
I20260618 19:57:12.996696 4307 consensus_queue.cc:260] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 51c7777f264b496a9bf9511966dcfbd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:12.997366 4307 ts_tablet_manager.cc:1434] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 51c7777f264b496a9bf9511966dcfbd7: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260618 19:57:12.997624 4307 tablet_bootstrap.cc:492] T 182415f6a2c94b9fa32ae241aced8853 P 51c7777f264b496a9bf9511966dcfbd7: Bootstrap starting.
I20260618 19:57:12.999346 4307 tablet_bootstrap.cc:654] T 182415f6a2c94b9fa32ae241aced8853 P 51c7777f264b496a9bf9511966dcfbd7: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:13.006807 4309 ts_tablet_manager.cc:1929] T 6dd4cd01d8e94363bec5d2897941d94a P 6bb3ca8239f4412fb8b0e7d0df9e50c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:13.006942 4309 log.cc:1199] T 6dd4cd01d8e94363bec5d2897941d94a P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/wal/wals/6dd4cd01d8e94363bec5d2897941d94a
I20260618 19:57:13.007345 4309 ts_tablet_manager.cc:1950] T 6dd4cd01d8e94363bec5d2897941d94a P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting consensus metadata
I20260618 19:57:13.009011 4309 tablet_replica.cc:333] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1: stopping tablet replica
I20260618 19:57:13.009290 4309 raft_consensus.cc:2243] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 LEADER]: Raft consensus shutting down.
I20260618 19:57:13.009545 4310 tablet_bootstrap.cc:492] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b: No bootstrap required, opened a new log
I20260618 19:57:13.009550 4307 tablet_bootstrap.cc:492] T 182415f6a2c94b9fa32ae241aced8853 P 51c7777f264b496a9bf9511966dcfbd7: No bootstrap required, opened a new log
I20260618 19:57:13.009696 4310 ts_tablet_manager.cc:1403] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b: Time spent bootstrapping tablet: real 0.034s user 0.021s sys 0.012s
I20260618 19:57:13.009716 4307 ts_tablet_manager.cc:1403] T 182415f6a2c94b9fa32ae241aced8853 P 51c7777f264b496a9bf9511966dcfbd7: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260618 19:57:13.009693 4309 raft_consensus.cc:2272] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:13.010469 4307 raft_consensus.cc:359] T 182415f6a2c94b9fa32ae241aced8853 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:13.010489 4310 raft_consensus.cc:359] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:13.010653 4310 raft_consensus.cc:385] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:13.010670 4307 raft_consensus.cc:385] T 182415f6a2c94b9fa32ae241aced8853 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:13.010740 4307 raft_consensus.cc:740] T 182415f6a2c94b9fa32ae241aced8853 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51c7777f264b496a9bf9511966dcfbd7, State: Initialized, Role: FOLLOWER
I20260618 19:57:13.010738 4310 raft_consensus.cc:740] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 722df47a60ca4bfa82104dea57718f3b, State: Initialized, Role: FOLLOWER
I20260618 19:57:13.010937 4309 ts_tablet_manager.cc:1916] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:13.010978 4310 consensus_queue.cc:260] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:13.010986 4307 consensus_queue.cc:260] T 182415f6a2c94b9fa32ae241aced8853 P 51c7777f264b496a9bf9511966dcfbd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:13.011514 4307 ts_tablet_manager.cc:1434] T 182415f6a2c94b9fa32ae241aced8853 P 51c7777f264b496a9bf9511966dcfbd7: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260618 19:57:13.011731 4310 ts_tablet_manager.cc:1434] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260618 19:57:13.011991 4310 tablet_bootstrap.cc:492] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b: Bootstrap starting.
I20260618 19:57:13.013761 4310 tablet_bootstrap.cc:654] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b: Neither blocks nor log segments found. Creating new log.
I20260618 19:57:13.018052 4309 ts_tablet_manager.cc:1929] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:13.018219 4309 log.cc:1199] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/wal/wals/59b33f9c5c494332a5892a1a1ef9672d
I20260618 19:57:13.018674 4309 ts_tablet_manager.cc:1950] T 59b33f9c5c494332a5892a1a1ef9672d P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting consensus metadata
I20260618 19:57:13.023365 4310 tablet_bootstrap.cc:492] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b: No bootstrap required, opened a new log
I20260618 19:57:13.023567 4310 ts_tablet_manager.cc:1403] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.006s
I20260618 19:57:13.024585 4310 raft_consensus.cc:359] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:13.024811 4310 raft_consensus.cc:385] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 19:57:13.024891 4310 raft_consensus.cc:740] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 722df47a60ca4bfa82104dea57718f3b, State: Initialized, Role: FOLLOWER
I20260618 19:57:13.025100 3993 raft_consensus.cc:493] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:13.025220 4310 consensus_queue.cc:260] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:13.025250 3993 raft_consensus.cc:515] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:13.026132 3993 leader_election.cc:290] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483)
I20260618 19:57:13.026324 4310 ts_tablet_manager.cc:1434] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260618 19:57:13.027007 3467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83164978e2724f98ac65581b775089b9" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "722df47a60ca4bfa82104dea57718f3b" is_pre_election: true
I20260618 19:57:13.027225 3467 raft_consensus.cc:2468] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 0.
I20260618 19:57:13.028132 3328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83164978e2724f98ac65581b775089b9" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7" is_pre_election: true
I20260618 19:57:13.028399 3328 raft_consensus.cc:2468] T 83164978e2724f98ac65581b775089b9 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 0.
I20260618 19:57:13.028931 3547 leader_election.cc:304] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bb3ca8239f4412fb8b0e7d0df9e50c1, 722df47a60ca4bfa82104dea57718f3b; no voters:
I20260618 19:57:13.029486 3993 raft_consensus.cc:2804] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 19:57:13.029599 3993 raft_consensus.cc:493] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 19:57:13.029687 3993 raft_consensus.cc:3060] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:13.032200 3993 raft_consensus.cc:515] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:13.033473 3328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83164978e2724f98ac65581b775089b9" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7"
I20260618 19:57:13.033540 3993 leader_election.cc:290] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 election: Requested vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483)
I20260618 19:57:13.033743 3328 raft_consensus.cc:3060] T 83164978e2724f98ac65581b775089b9 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:13.034154 3467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83164978e2724f98ac65581b775089b9" candidate_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "722df47a60ca4bfa82104dea57718f3b"
I20260618 19:57:13.034322 3467 raft_consensus.cc:3060] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:13.036636 3467 raft_consensus.cc:2468] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 1.
I20260618 19:57:13.036798 3328 raft_consensus.cc:2468] T 83164978e2724f98ac65581b775089b9 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb3ca8239f4412fb8b0e7d0df9e50c1 in term 1.
I20260618 19:57:13.037223 3547 leader_election.cc:304] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bb3ca8239f4412fb8b0e7d0df9e50c1, 722df47a60ca4bfa82104dea57718f3b; no voters:
I20260618 19:57:13.037592 3993 raft_consensus.cc:2804] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 19:57:13.038105 3993 raft_consensus.cc:697] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 LEADER]: Becoming Leader. State: Replica: 6bb3ca8239f4412fb8b0e7d0df9e50c1, State: Running, Role: LEADER
I20260618 19:57:13.038798 3993 consensus_queue.cc:237] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
W20260618 19:57:13.139055 3263 connection.cc:573] server connection from 127.0.0.1:37810 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260618 19:57:13.139096 3403 connection.cc:573] server connection from 127.0.0.1:53668 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260618 19:57:13.139084 3545 connection.cc:573] server connection from 127.0.0.1:44032 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260618 19:57:13.139508 3546 connection.cc:573] client connection to 127.2.158.188:34975 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260618 19:57:13.139496 3402 connection.cc:573] client connection to 127.2.158.188:34975 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260618 19:57:13.140082 3668 connection.cc:573] client connection to 127.2.158.188:34975 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260618 19:57:13.140381 3263 connection.cc:573] client connection to 127.2.158.188:34975 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260618 19:57:13.140697 3668 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.2.158.188:34975)
W20260618 19:57:13.141384 3668 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.2.158.188:34975)
W20260618 19:57:13.141563 3668 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.2.158.188:34975)
W20260618 19:57:13.142285 3668 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.2.158.188:34975)
I20260618 19:57:13.170866 4286 raft_consensus.cc:493] T 15e541a8d092404eb2b2920893b94da3 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:13.171087 4286 raft_consensus.cc:515] T 15e541a8d092404eb2b2920893b94da3 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:13.171816 4286 leader_election.cc:290] T 15e541a8d092404eb2b2920893b94da3 P 51c7777f264b496a9bf9511966dcfbd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483), 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:13.172410 3467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e541a8d092404eb2b2920893b94da3" candidate_uuid: "51c7777f264b496a9bf9511966dcfbd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "722df47a60ca4bfa82104dea57718f3b" is_pre_election: true
I20260618 19:57:13.172459 3610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e541a8d092404eb2b2920893b94da3" candidate_uuid: "51c7777f264b496a9bf9511966dcfbd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" is_pre_election: true
I20260618 19:57:13.172654 3467 raft_consensus.cc:2468] T 15e541a8d092404eb2b2920893b94da3 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51c7777f264b496a9bf9511966dcfbd7 in term 0.
I20260618 19:57:13.172698 3610 raft_consensus.cc:2468] T 15e541a8d092404eb2b2920893b94da3 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51c7777f264b496a9bf9511966dcfbd7 in term 0.
I20260618 19:57:13.173069 3264 leader_election.cc:304] T 15e541a8d092404eb2b2920893b94da3 P 51c7777f264b496a9bf9511966dcfbd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7, 722df47a60ca4bfa82104dea57718f3b; no voters:
I20260618 19:57:13.173403 4286 raft_consensus.cc:2804] T 15e541a8d092404eb2b2920893b94da3 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 19:57:13.173527 4286 raft_consensus.cc:493] T 15e541a8d092404eb2b2920893b94da3 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 19:57:13.173638 4286 raft_consensus.cc:3060] T 15e541a8d092404eb2b2920893b94da3 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:13.176056 4286 raft_consensus.cc:515] T 15e541a8d092404eb2b2920893b94da3 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:13.176585 4286 leader_election.cc:290] T 15e541a8d092404eb2b2920893b94da3 P 51c7777f264b496a9bf9511966dcfbd7 [CANDIDATE]: Term 1 election: Requested vote from peers 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483), 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:13.177106 3467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e541a8d092404eb2b2920893b94da3" candidate_uuid: "51c7777f264b496a9bf9511966dcfbd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "722df47a60ca4bfa82104dea57718f3b"
I20260618 19:57:13.177254 3610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e541a8d092404eb2b2920893b94da3" candidate_uuid: "51c7777f264b496a9bf9511966dcfbd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1"
I20260618 19:57:13.177346 3467 raft_consensus.cc:3060] T 15e541a8d092404eb2b2920893b94da3 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:13.177498 3610 raft_consensus.cc:3060] T 15e541a8d092404eb2b2920893b94da3 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:13.180097 3467 raft_consensus.cc:2468] T 15e541a8d092404eb2b2920893b94da3 P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51c7777f264b496a9bf9511966dcfbd7 in term 1.
I20260618 19:57:13.180159 3610 raft_consensus.cc:2468] T 15e541a8d092404eb2b2920893b94da3 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51c7777f264b496a9bf9511966dcfbd7 in term 1.
I20260618 19:57:13.180541 3264 leader_election.cc:304] T 15e541a8d092404eb2b2920893b94da3 P 51c7777f264b496a9bf9511966dcfbd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7, 6bb3ca8239f4412fb8b0e7d0df9e50c1; no voters:
I20260618 19:57:13.180879 4286 raft_consensus.cc:2804] T 15e541a8d092404eb2b2920893b94da3 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 19:57:13.181342 4286 raft_consensus.cc:697] T 15e541a8d092404eb2b2920893b94da3 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 LEADER]: Becoming Leader. State: Replica: 51c7777f264b496a9bf9511966dcfbd7, State: Running, Role: LEADER
I20260618 19:57:13.181890 4286 consensus_queue.cc:237] T 15e541a8d092404eb2b2920893b94da3 P 51c7777f264b496a9bf9511966dcfbd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } } peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } }
I20260618 19:57:13.302495 4254 raft_consensus.cc:493] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:13.302731 4254 raft_consensus.cc:515] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:13.303568 4254 leader_election.cc:290] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:13.304101 3328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b5d60c1e3e4323866ddd8e5b8881b6" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7" is_pre_election: true
I20260618 19:57:13.304219 3610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b5d60c1e3e4323866ddd8e5b8881b6" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" is_pre_election: true
I20260618 19:57:13.304339 3328 raft_consensus.cc:2468] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 722df47a60ca4bfa82104dea57718f3b in term 0.
I20260618 19:57:13.304494 3610 raft_consensus.cc:2468] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 722df47a60ca4bfa82104dea57718f3b in term 0.
I20260618 19:57:13.304797 3402 leader_election.cc:304] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7, 722df47a60ca4bfa82104dea57718f3b; no voters:
I20260618 19:57:13.305078 4254 raft_consensus.cc:2804] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 19:57:13.305205 4254 raft_consensus.cc:493] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 19:57:13.305366 4254 raft_consensus.cc:3060] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:13.307408 4254 raft_consensus.cc:515] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:13.307997 4254 leader_election.cc:290] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 election: Requested vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:13.308537 3610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b5d60c1e3e4323866ddd8e5b8881b6" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1"
I20260618 19:57:13.308535 3328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b5d60c1e3e4323866ddd8e5b8881b6" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7"
I20260618 19:57:13.308743 3610 raft_consensus.cc:3060] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:13.308756 3328 raft_consensus.cc:3060] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:13.310832 3328 raft_consensus.cc:2468] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 722df47a60ca4bfa82104dea57718f3b in term 1.
I20260618 19:57:13.310842 3610 raft_consensus.cc:2468] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 722df47a60ca4bfa82104dea57718f3b in term 1.
I20260618 19:57:13.311275 3402 leader_election.cc:304] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7, 722df47a60ca4bfa82104dea57718f3b; no voters:
I20260618 19:57:13.311650 4254 raft_consensus.cc:2804] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Leader election won for term 1
I20260618 19:57:13.312125 4254 raft_consensus.cc:697] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 722df47a60ca4bfa82104dea57718f3b [term 1 LEADER]: Becoming Leader. State: Replica: 722df47a60ca4bfa82104dea57718f3b, State: Running, Role: LEADER
I20260618 19:57:13.312608 4254 consensus_queue.cc:237] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 722df47a60ca4bfa82104dea57718f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:13.366766 4337 raft_consensus.cc:493] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6c13c838eb85465090e1bff0df28912f)
I20260618 19:57:13.366991 4337 raft_consensus.cc:515] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:13.368968 4337 leader_election.cc:290] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955), 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975)
W20260618 19:57:13.370034 4199 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
W20260618 19:57:13.371624 4199 leader_election.cc:336] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
W20260618 19:57:13.371951 4199 leader_election.cc:336] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975): Network error: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111)
I20260618 19:57:13.372090 4199 leader_election.cc:304] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acc600e5aa44409ea3ce4c2861cb4de1; no voters: 0447960184714aaf886ca15b9aa0e63a, 6c13c838eb85465090e1bff0df28912f
I20260618 19:57:13.372470 4337 raft_consensus.cc:2749] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260618 19:57:13.461253 4254 raft_consensus.cc:493] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:13.461548 4254 raft_consensus.cc:515] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:13.462271 4254 leader_election.cc:290] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:13.462893 3328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182415f6a2c94b9fa32ae241aced8853" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7" is_pre_election: true
I20260618 19:57:13.462894 3610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182415f6a2c94b9fa32ae241aced8853" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" is_pre_election: true
I20260618 19:57:13.463130 3328 raft_consensus.cc:2468] T 182415f6a2c94b9fa32ae241aced8853 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 722df47a60ca4bfa82104dea57718f3b in term 0.
I20260618 19:57:13.463141 3610 raft_consensus.cc:2468] T 182415f6a2c94b9fa32ae241aced8853 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 722df47a60ca4bfa82104dea57718f3b in term 0.
I20260618 19:57:13.463608 3402 leader_election.cc:304] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7, 722df47a60ca4bfa82104dea57718f3b; no voters:
I20260618 19:57:13.463886 4254 raft_consensus.cc:2804] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 19:57:13.463968 4254 raft_consensus.cc:493] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 19:57:13.464035 4254 raft_consensus.cc:3060] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:13.465858 4254 raft_consensus.cc:515] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:13.466432 4254 leader_election.cc:290] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 election: Requested vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:13.466800 3328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182415f6a2c94b9fa32ae241aced8853" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7"
I20260618 19:57:13.466902 3610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182415f6a2c94b9fa32ae241aced8853" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1"
I20260618 19:57:13.467015 3328 raft_consensus.cc:3060] T 182415f6a2c94b9fa32ae241aced8853 P 51c7777f264b496a9bf9511966dcfbd7 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:13.467137 3610 raft_consensus.cc:3060] T 182415f6a2c94b9fa32ae241aced8853 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 0 FOLLOWER]: Advancing to term 1
I20260618 19:57:13.468931 3610 raft_consensus.cc:2468] T 182415f6a2c94b9fa32ae241aced8853 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 722df47a60ca4bfa82104dea57718f3b in term 1.
I20260618 19:57:13.469451 3328 raft_consensus.cc:2468] T 182415f6a2c94b9fa32ae241aced8853 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 722df47a60ca4bfa82104dea57718f3b in term 1.
I20260618 19:57:13.469509 3403 leader_election.cc:304] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bb3ca8239f4412fb8b0e7d0df9e50c1, 722df47a60ca4bfa82104dea57718f3b; no voters:
I20260618 19:57:13.469832 4254 raft_consensus.cc:2804] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Leader election won for term 1
I20260618 19:57:13.470027 4254 raft_consensus.cc:697] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b [term 1 LEADER]: Becoming Leader. State: Replica: 722df47a60ca4bfa82104dea57718f3b, State: Running, Role: LEADER
I20260618 19:57:13.470376 4254 consensus_queue.cc:237] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:13.863827 3993 consensus_queue.cc:1048] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:13.870604 4348 consensus_queue.cc:1048] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:13.944376 4353 raft_consensus.cc:493] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6c13c838eb85465090e1bff0df28912f)
I20260618 19:57:13.944650 4353 raft_consensus.cc:515] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:13.945420 4353 leader_election.cc:290] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955), 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975)
W20260618 19:57:13.948216 4199 leader_election.cc:336] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
W20260618 19:57:13.948484 4199 leader_election.cc:336] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975): Network error: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111)
I20260618 19:57:13.948654 4199 leader_election.cc:304] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acc600e5aa44409ea3ce4c2861cb4de1; no voters: 0447960184714aaf886ca15b9aa0e63a, 6c13c838eb85465090e1bff0df28912f
I20260618 19:57:13.948976 4353 raft_consensus.cc:2749] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260618 19:57:14.087035 4350 consensus_queue.cc:1048] T 15e541a8d092404eb2b2920893b94da3 P 51c7777f264b496a9bf9511966dcfbd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:14.093186 4358 consensus_queue.cc:1048] T 15e541a8d092404eb2b2920893b94da3 P 51c7777f264b496a9bf9511966dcfbd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:14.129072 4254 consensus_queue.cc:1048] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 722df47a60ca4bfa82104dea57718f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:14.137979 4362 consensus_queue.cc:1048] T 42b5d60c1e3e4323866ddd8e5b8881b6 P 722df47a60ca4bfa82104dea57718f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:14.327946 4362 consensus_queue.cc:1048] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:14.333364 4363 consensus_queue.cc:1048] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 19:57:14.504760 4368 raft_consensus.cc:493] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6c13c838eb85465090e1bff0df28912f)
I20260618 19:57:14.504971 4368 raft_consensus.cc:515] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:14.506770 4368 leader_election.cc:290] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955), 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975)
W20260618 19:57:14.509627 4199 leader_election.cc:336] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
W20260618 19:57:14.509902 4199 leader_election.cc:336] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975): Network error: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111)
I20260618 19:57:14.510047 4199 leader_election.cc:304] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acc600e5aa44409ea3ce4c2861cb4de1; no voters: 0447960184714aaf886ca15b9aa0e63a, 6c13c838eb85465090e1bff0df28912f
I20260618 19:57:14.510426 4368 raft_consensus.cc:2749] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260618 19:57:15.266836 2682 external_mini_cluster.cc:1372] Running /tmp/dist-test-task_3iVrE/build/asan/bin/kudu
/tmp/dist-test-task_3iVrE/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.158.189:45955
--webserver_interface=127.2.158.189
--webserver_port=36353
--builtin_ntp_servers=127.2.158.148:40109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975
--hive_metastore_uris=thrift://127.0.0.1:43379
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260618 19:57:15.631012 4383 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 19:57:15.631345 4383 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 19:57:15.631413 4383 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260618 19:57:15.640174 4383 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 19:57:15.640269 4383 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260618 19:57:15.640323 4383 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 19:57:15.640369 4383 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260618 19:57:15.650707 4383 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.158.148:40109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:43379
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.158.189:45955
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.2.158.189
--webserver_port=36353
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 18 Jun 2026 19:43:24 UTC on bdcb31816ec0
build id 12458
ASAN enabled
I20260618 19:57:15.652639 4383 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 19:57:15.654811 4383 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260618 19:57:15.663988 4393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 19:57:15.664497 4394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 19:57:15.664999 4396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 19:57:15.665772 4383 server_base.cc:1061] running on GCE node
I20260618 19:57:15.666533 4383 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 19:57:15.667981 4383 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 19:57:15.669232 4383 hybrid_clock.cc:648] HybridClock initialized: now 1781812635669178 us; error 41 us; skew 500 ppm
I20260618 19:57:15.669641 4383 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260618 19:57:15.671918 4383 webserver.cc:533] Webserver started at http://127.2.158.189:36353/ using document root <none> and password file <none>
I20260618 19:57:15.672686 4383 fs_manager.cc:362] Metadata directory not provided
I20260618 19:57:15.672830 4383 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 19:57:15.678361 4383 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260618 19:57:15.681598 4402 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 19:57:15.682919 4383 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260618 19:57:15.683099 4383 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/data,/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/wal
uuid: "0447960184714aaf886ca15b9aa0e63a"
format_stamp: "Formatted at 2026-06-18 19:56:59 on dist-test-slave-6zlr"
I20260618 19:57:15.683820 4383 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 19:57:15.706887 4383 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 19:57:15.708073 4383 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 19:57:15.708375 4383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 19:57:15.731546 4383 rpc_server.cc:307] RPC server started. Bound to: 127.2.158.189:45955
I20260618 19:57:15.731582 4453 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.158.189:45955 every 8 connection(s)
I20260618 19:57:15.733203 4383 server_base.cc:1193] Dumped server information to /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/data/info.pb
I20260618 19:57:15.739907 2682 external_mini_cluster.cc:1434] Started /tmp/dist-test-task_3iVrE/build/asan/bin/kudu as pid 4383
I20260618 19:57:15.740093 4454 sys_catalog.cc:263] Verifying existing consensus state
I20260618 19:57:15.744656 4454 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: Bootstrap starting.
I20260618 19:57:15.758301 4454 log.cc:826] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: Log is configured to *not* fsync() on all Append() calls
I20260618 19:57:15.783913 4458 raft_consensus.cc:493] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6c13c838eb85465090e1bff0df28912f)
I20260618 19:57:15.784160 4458 raft_consensus.cc:515] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:15.784883 4458 leader_election.cc:290] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955), 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975)
W20260618 19:57:15.787663 4199 leader_election.cc:336] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975): Network error: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111)
I20260618 19:57:15.800452 4454 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: Bootstrap replayed 1/1 log segments. Stats: ops{read=44 overwritten=0 applied=43 ignored=0} inserts{seen=29 ignored=0} mutations{seen=30 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260618 19:57:15.801456 4454 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: Bootstrap complete.
I20260618 19:57:15.809118 4454 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 4 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:15.812649 4454 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0447960184714aaf886ca15b9aa0e63a, State: Initialized, Role: FOLLOWER
I20260618 19:57:15.813608 4454 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 43, Last appended: 4.44, Last appended by leader: 44, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:15.814548 4464 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:15.814913 4464 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: This master's current role is: FOLLOWER
I20260618 19:57:15.816030 4454 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: configured and running, proceeding with master startup.
I20260618 19:57:15.816000 4429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" candidate_term: 6 candidate_status { last_received { term: 5 index: 51 } } ignore_live_leader: false dest_uuid: "0447960184714aaf886ca15b9aa0e63a" is_pre_election: true
I20260618 19:57:15.816854 4429 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acc600e5aa44409ea3ce4c2861cb4de1 in term 4.
I20260618 19:57:15.817528 4199 leader_election.cc:304] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1; no voters: 6c13c838eb85465090e1bff0df28912f
I20260618 19:57:15.817852 4458 raft_consensus.cc:2804] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260618 19:57:15.817973 4458 raft_consensus.cc:493] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6c13c838eb85465090e1bff0df28912f)
I20260618 19:57:15.818058 4458 raft_consensus.cc:3060] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 5 FOLLOWER]: Advancing to term 6
I20260618 19:57:15.820372 4458 raft_consensus.cc:515] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:15.820979 4458 leader_election.cc:290] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [CANDIDATE]: Term 6 election: Requested vote from peers 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955), 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975)
I20260618 19:57:15.822134 4429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" candidate_term: 6 candidate_status { last_received { term: 5 index: 51 } } ignore_live_leader: false dest_uuid: "0447960184714aaf886ca15b9aa0e63a"
I20260618 19:57:15.822386 4429 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 4 FOLLOWER]: Advancing to term 6
W20260618 19:57:15.822695 4199 leader_election.cc:336] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975): Network error: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111)
I20260618 19:57:15.826354 3514 heartbeater.cc:344] Connected to a master server at 127.2.158.189:45955
I20260618 19:57:15.829360 4429 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acc600e5aa44409ea3ce4c2861cb4de1 in term 6.
I20260618 19:57:15.830041 4199 leader_election.cc:304] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1; no voters: 6c13c838eb85465090e1bff0df28912f
I20260618 19:57:15.830487 4458 raft_consensus.cc:2804] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 6 FOLLOWER]: Leader election won for term 6
I20260618 19:57:15.830981 4458 raft_consensus.cc:697] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [term 6 LEADER]: Becoming Leader. State: Replica: acc600e5aa44409ea3ce4c2861cb4de1, State: Running, Role: LEADER
I20260618 19:57:15.831631 4458 consensus_queue.cc:237] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 51, Committed index: 51, Last appended: 5.51, Last appended by leader: 51, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:15.833501 4475 sys_catalog.cc:455] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader acc600e5aa44409ea3ce4c2861cb4de1. Latest consensus state: current_term: 6 leader_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:15.833781 4475 sys_catalog.cc:458] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [sys.catalog]: This master's current role is: LEADER
I20260618 19:57:15.838670 4482 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260618 19:57:15.843011 4482 catalog_manager.cc:679] Loaded metadata for table default.table_28d033357fdb4b29b0abfeebb5ef122b [id=58a0cd369a884f1fb371a75c1794f738]
I20260618 19:57:15.843851 4482 catalog_manager.cc:679] Loaded metadata for table default.table_e1e6b231bd514a58a66b66d04eff6e48 [id=5a73fe372e7f47b49ed9219558f0194e]
I20260618 19:57:15.844578 4482 catalog_manager.cc:679] Loaded metadata for table default.table_4957212a0ca5452e98630b441906262f [id=749b241f59b34125a9ff8d7c847ddd3d]
I20260618 19:57:15.845217 4482 catalog_manager.cc:679] Loaded metadata for table default.table_4f9cd241b4284c4796f2aba3ccec0e35 [id=873b29232cab4ad9a9f8c070455c98a9]
I20260618 19:57:15.845881 4482 catalog_manager.cc:679] Loaded metadata for table default.table_77c95317631d4b1eab1943139e888ecb [id=aca591adc1fb402ca2dcd58765479d54]
I20260618 19:57:15.846606 4482 catalog_manager.cc:679] Loaded metadata for table default.table_b11e5cb8e5194655b89a8452d2eb25f5 [id=b3a217a305294496bd2ad3d3eed4e179]
I20260618 19:57:15.847221 4482 catalog_manager.cc:679] Loaded metadata for table default.table_8a3fffa237bc419e8921a2b75f70e639 [id=c256b56cd126492ea4f98f7d075e0a53]
I20260618 19:57:15.847774 4482 catalog_manager.cc:679] Loaded metadata for table default.table_736a38f9f9fe4dc7aed9092c9b7b33cb [id=e0eb4bb31ccb4cb58174534059e2ce81]
I20260618 19:57:15.848261 4482 catalog_manager.cc:679] Loaded metadata for table default.table_39c8f72f53c5475bb66b72b21bd13991 [id=e13d5a8056214b30b410b665b7184922]
I20260618 19:57:15.850337 4479 catalog_manager.cc:1294] Loaded cluster ID: 2cd457c38b944bab8903c2f58018327f
I20260618 19:57:15.850826 4482 tablet_loader.cc:96] loaded metadata for tablet 15e541a8d092404eb2b2920893b94da3 (table default.table_736a38f9f9fe4dc7aed9092c9b7b33cb [id=e0eb4bb31ccb4cb58174534059e2ce81])
I20260618 19:57:15.851352 4482 tablet_loader.cc:96] loaded metadata for tablet 182415f6a2c94b9fa32ae241aced8853 (table default.table_8a3fffa237bc419e8921a2b75f70e639 [id=c256b56cd126492ea4f98f7d075e0a53])
I20260618 19:57:15.852156 4482 tablet_loader.cc:96] loaded metadata for tablet 42b5d60c1e3e4323866ddd8e5b8881b6 (table default.table_77c95317631d4b1eab1943139e888ecb [id=aca591adc1fb402ca2dcd58765479d54])
I20260618 19:57:15.852670 4479 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: loading cluster ID for follower catalog manager: success
I20260618 19:57:15.856998 4482 tablet_loader.cc:96] loaded metadata for tablet 48c932d095ea475abc03d02def7e9a27 (table default.table_28d033357fdb4b29b0abfeebb5ef122b [id=58a0cd369a884f1fb371a75c1794f738])
I20260618 19:57:15.859277 4482 tablet_loader.cc:96] loaded metadata for tablet 729a419e001f43b681075130b9543835 (table default.table_e1e6b231bd514a58a66b66d04eff6e48 [id=5a73fe372e7f47b49ed9219558f0194e])
I20260618 19:57:15.859699 4482 tablet_loader.cc:96] loaded metadata for tablet 83164978e2724f98ac65581b775089b9 (table default.table_4957212a0ca5452e98630b441906262f [id=749b241f59b34125a9ff8d7c847ddd3d])
I20260618 19:57:15.860088 4482 tablet_loader.cc:96] loaded metadata for tablet 8dd15a7fb224481593155899a99c249c (table default.table_39c8f72f53c5475bb66b72b21bd13991 [id=e13d5a8056214b30b410b665b7184922])
I20260618 19:57:15.861514 4482 tablet_loader.cc:96] loaded metadata for tablet bce5543840af43b7b9933eb585ceeb80 (table default.table_b11e5cb8e5194655b89a8452d2eb25f5 [id=b3a217a305294496bd2ad3d3eed4e179])
I20260618 19:57:15.862480 4482 tablet_loader.cc:96] loaded metadata for tablet f45d6e214bb646cdbf84ee1572859863 (table default.table_4f9cd241b4284c4796f2aba3ccec0e35 [id=873b29232cab4ad9a9f8c070455c98a9])
I20260618 19:57:15.863080 4482 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260618 19:57:15.864488 4482 catalog_manager.cc:1294] Loaded cluster ID: 2cd457c38b944bab8903c2f58018327f
I20260618 19:57:15.865243 4482 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260618 19:57:15.865242 4479 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: acquiring CA information for follower catalog manager: success
I20260618 19:57:15.867467 4482 catalog_manager.cc:1539] Loading token signing keys...
I20260618 19:57:15.868665 4482 catalog_manager.cc:6080] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1: Loaded TSK: 0
I20260618 19:57:15.869019 4479 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260618 19:57:15.869639 4482 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260618 19:57:15.870894 4482 catalog_manager.cc:1562] Loading latest processed Hive Metastore notification log event ID...
I20260618 19:57:15.871968 4482 catalog_manager.cc:5918] Last processed Hive Metastore notification event ID: -1
I20260618 19:57:15.875327 4383 master_runner.cc:187] Error getting master registration for 127.2.158.188:34975: Network error: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111),
I20260618 19:57:15.880034 4383 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260618 19:57:15.924237 3658 heartbeater.cc:344] Connected to a master server at 127.2.158.189:45955
I20260618 19:57:15.924461 3658 heartbeater.cc:499] Master 127.2.158.189:45955 was elected leader, sending a full tablet report...
I20260618 19:57:15.927824 4419 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" instance_seqno: 1781812622463911) as {username='slave'} at 127.2.158.131:60485; Asking this server to re-register.
I20260618 19:57:15.928725 3658 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:15.930658 4419 ts_manager.cc:194] Registered new tserver with Master: 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:15.943668 4212 master_service.cc:960] ReplaceTablet: received request to replace tablet f45d6e214bb646cdbf84ee1572859863 from {username='slave'} at 127.0.0.1:58714
I20260618 19:57:15.945032 4205 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58714:
name: "default.Table_ddc5d076daac47b4bd3e0dacbde21f5f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:15.946498 4213 master_service.cc:960] ReplaceTablet: received request to replace tablet f45d6e214bb646cdbf84ee1572859863 from {username='slave'} at 127.0.0.1:58714
I20260618 19:57:15.946971 4211 master_service.cc:960] ReplaceTablet: received request to replace tablet 15e541a8d092404eb2b2920893b94da3 from {username='slave'} at 127.0.0.1:58714
I20260618 19:57:15.946861 4204 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58714:
name: "default.Table_62590bf88ede4e85b45e9a0cc4185c2c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:15.948673 4210 master_service.cc:960] ReplaceTablet: received request to replace tablet 15e541a8d092404eb2b2920893b94da3 from {username='slave'} at 127.0.0.1:58714
I20260618 19:57:15.949168 4208 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58714:
name: "default.Table_917e434e2f0140148e432b0324ad9763"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:15.950491 4207 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58714:
table { table_name: "default.Table_28d033357fdb4b29b0abfeebb5ef122b" } modify_external_catalogs: true
I20260618 19:57:15.950745 4207 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58714:
table { table_name: "default.Table_28d033357fdb4b29b0abfeebb5ef122b" } modify_external_catalogs: true
I20260618 19:57:15.951257 4206 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58714:
table { table_name: "default.Table_8a3fffa237bc419e8921a2b75f70e639" } modify_external_catalogs: true
I20260618 19:57:15.951463 4206 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58714:
table { table_name: "default.Table_8a3fffa237bc419e8921a2b75f70e639" } modify_external_catalogs: true
I20260618 19:57:15.951673 4209 master_service.cc:960] ReplaceTablet: received request to replace tablet f45d6e214bb646cdbf84ee1572859863 from {username='slave'} at 127.0.0.1:58714
F20260618 19:57:15.954856 4269 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 1, previous 1; dumping first 2 out of 10 received events: NotificationEvent(eventId=1, eventTime=1781812622, eventType=CREATE_TABLE, dbName=default, tableName=table_402627eeff7b4c338e64cfbe575411be, message={"server":"","servicePrincipal":"","db":"default","table":"table_402627eeff7b4c338e64cfbe575411be","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_402627eeff7b4c338e64cfbe575411be\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1781812622},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/warehouse/table_402627eeff7b4c338e64cfbe575411be\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_402627eeff7b4c338e64cfbe575411be\",\"kudu.table_id\":\"d0b8f5d092934582ab6ebf43cd6f9f6f\",\"transient_lastDdlTime\":\"1781812622\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"2cd457c38b944bab8903c2f58018327f\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1781812622,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=1, eventTime=1781812622, eventType=CREATE_TABLE, dbName=default, tableName=table_4957212a0ca5452e98630b441906262f, message={"server":"","servicePrincipal":"","db":"default","table":"table_4957212a0ca5452e98630b441906262f","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_4957212a0ca5452e98630b441906262f\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1781812622},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/warehouse/table_4957212a0ca5452e98630b441906262f\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_4957212a0ca5452e98630b441906262f\",\"kudu.table_id\":\"749b241f59b34125a9ff8d7c847ddd3d\",\"transient_lastDdlTime\":\"1781812622\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"2cd457c38b944bab8903c2f58018327f\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1781812622,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7f7c8f7bddcd google::LogMessage::Fail() at ??:0
@ 0x7f7c8f7c1b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f7c8f7bd7cc google::LogMessage::Flush() at ??:0
I20260618 19:57:15.963936 4429 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Refusing update from remote peer acc600e5aa44409ea3ce4c2861cb4de1: Log matching property violated. Preceding OpId in replica: term: 4 index: 44. Preceding OpId from leader: term: 6 index: 53. (index mismatch)
W20260618 19:57:15.964112 4199 consensus_peers.cc:597] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 -> Peer 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975): Couldn't send request to peer 6c13c838eb85465090e1bff0df28912f. Status: Network error: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260618 19:57:15.965016 4475 consensus_queue.cc:1048] T 00000000000000000000000000000000 P acc600e5aa44409ea3ce4c2861cb4de1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 52, Last known committed idx: 43, Time since last communication: 0.000s
@ 0x7f7c8f7bda11 google::LogMessage::~LogMessage() at ??:0
@ 0x7f7ca63b8394 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f7ca63b6c41 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7f7ca63be8bc kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260618 19:57:16.000541 4462 mvcc.cc:204] Tried to move back new op lower bound from 7298304544091987968 to 7298304543373983744. Current Snapshot: MvccSnapshot[applied={T|T < 7298304544091987968 or (T in {7298304544091987968})}]
@ 0x7f7ca63be739 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa681d std::function<>::operator()() at ??:?
@ 0x7f7c924e4f49 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f7c95bae6db start_thread at ??:0
I20260618 19:57:16.015493 4464 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: SysCatalogTable state changed. Reason: New leader acc600e5aa44409ea3ce4c2861cb4de1. Latest consensus state: current_term: 6 leader_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:16.015812 4464 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: This master's current role is: FOLLOWER
I20260618 19:57:16.016244 4493 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:16.016499 4493 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7f7c8e66c61f clone at ??:0
I20260618 19:57:16.020625 4497 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:16.020994 4497 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: This master's current role is: FOLLOWER
I20260618 19:57:16.187563 3375 heartbeater.cc:344] Connected to a master server at 127.2.158.189:45955
I20260618 19:57:16.190018 4419 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" instance_seqno: 1781812621349212) as {username='slave'} at 127.2.158.129:33935; Asking this server to re-register.
I20260618 19:57:16.192965 3375 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:16.195254 4419 ts_manager.cc:194] Registered new tserver with Master: 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205)
W20260618 19:57:16.276211 4403 connection.cc:573] server connection from 127.0.0.1:57514 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260618 19:57:16.276680 3261 connection.cc:573] client connection to 127.2.158.190:41233 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260618 19:57:16.276878 3666 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.2.158.190:41233)
W20260618 19:57:16.277165 3666 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.2.158.190:41233)
W20260618 19:57:16.277530 3666 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.2.158.190:41233)
W20260618 19:57:16.278158 3666 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.2.158.190:41233)
I20260618 19:57:16.332036 4418 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" instance_seqno: 1781812621902304) as {username='slave'} at 127.2.158.130:53131; Asking this server to re-register.
I20260618 19:57:16.332728 3514 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:16.334314 4418 ts_manager.cc:194] Registered new tserver with Master: 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483)
I20260618 19:57:16.418263 3656 heartbeater.cc:499] Master 127.2.158.190:41233 was elected leader, sending a full tablet report...
I20260618 19:57:16.505925 4497 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader acc600e5aa44409ea3ce4c2861cb4de1)
I20260618 19:57:16.506255 4497 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:16.508282 4497 leader_election.cc:290] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975)
W20260618 19:57:16.509977 4403 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:57:16.511615 4403 leader_election.cc:336] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:57:16.511840 4405 leader_election.cc:336] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975): Network error: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111)
I20260618 19:57:16.512015 4405 leader_election.cc:304] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0447960184714aaf886ca15b9aa0e63a; no voters: 6c13c838eb85465090e1bff0df28912f, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:16.512408 4497 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260618 19:57:17.127015 4520 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader acc600e5aa44409ea3ce4c2861cb4de1)
I20260618 19:57:17.127219 4520 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:17.127882 4520 leader_election.cc:290] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975)
W20260618 19:57:17.130897 4405 leader_election.cc:336] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975): Network error: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111)
W20260618 19:57:17.131222 4403 leader_election.cc:336] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 19:57:17.131423 4403 leader_election.cc:304] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0447960184714aaf886ca15b9aa0e63a; no voters: 6c13c838eb85465090e1bff0df28912f, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:17.131726 4520 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260618 19:57:18.009608 4534 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader acc600e5aa44409ea3ce4c2861cb4de1)
I20260618 19:57:18.009878 4534 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:18.010533 4534 leader_election.cc:290] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975)
W20260618 19:57:18.013154 4405 leader_election.cc:336] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975): Network error: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111)
W20260618 19:57:18.013446 4403 leader_election.cc:336] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 19:57:18.013603 4403 leader_election.cc:304] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0447960184714aaf886ca15b9aa0e63a; no voters: 6c13c838eb85465090e1bff0df28912f, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:18.013938 4534 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260618 19:57:18.188257 2682 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task_3iVrE/build/asan/bin/kudu pid 4383
I20260618 19:57:18.200647 4449 generic_service.cc:196] Checking for leaks (request via RPC)
I20260618 19:57:18.331492 2682 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task_3iVrE/build/asan/bin/kudu with pid 4383
I20260618 19:57:19.205372 2682 external_mini_cluster.cc:1372] Running /tmp/dist-test-task_3iVrE/build/asan/bin/kudu
/tmp/dist-test-task_3iVrE/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.158.189:45955
--webserver_interface=127.2.158.189
--webserver_port=36353
--builtin_ntp_servers=127.2.158.148:40109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975
--hive_metastore_uris=thrift://127.0.0.1:43379
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260618 19:57:19.569082 4556 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 19:57:19.569530 4556 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 19:57:19.569685 4556 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260618 19:57:19.579329 4556 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 19:57:19.579428 4556 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260618 19:57:19.579520 4556 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 19:57:19.579603 4556 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260618 19:57:19.591252 4556 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.158.148:40109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:43379
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.158.189:45955
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.2.158.189
--webserver_port=36353
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 18 Jun 2026 19:43:24 UTC on bdcb31816ec0
build id 12458
ASAN enabled
I20260618 19:57:19.593029 4556 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 19:57:19.595013 4556 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260618 19:57:19.604085 4566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 19:57:19.604331 4568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 19:57:19.604032 4565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 19:57:19.605515 4556 server_base.cc:1061] running on GCE node
I20260618 19:57:19.606349 4556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 19:57:19.607909 4556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 19:57:19.609200 4556 hybrid_clock.cc:648] HybridClock initialized: now 1781812639609134 us; error 37 us; skew 500 ppm
I20260618 19:57:19.609633 4556 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260618 19:57:19.612030 4556 webserver.cc:533] Webserver started at http://127.2.158.189:36353/ using document root <none> and password file <none>
I20260618 19:57:19.612849 4556 fs_manager.cc:362] Metadata directory not provided
I20260618 19:57:19.613009 4556 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 19:57:19.618758 4556 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.000s sys 0.004s
I20260618 19:57:19.622196 4574 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 19:57:19.624071 4556 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260618 19:57:19.624275 4556 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/data,/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/wal
uuid: "0447960184714aaf886ca15b9aa0e63a"
format_stamp: "Formatted at 2026-06-18 19:56:59 on dist-test-slave-6zlr"
I20260618 19:57:19.625073 4556 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 19:57:19.642676 4556 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 19:57:19.643656 4556 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 19:57:19.644003 4556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 19:57:19.667672 4556 rpc_server.cc:307] RPC server started. Bound to: 127.2.158.189:45955
I20260618 19:57:19.667721 4625 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.158.189:45955 every 8 connection(s)
I20260618 19:57:19.669539 4556 server_base.cc:1193] Dumped server information to /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/data/info.pb
I20260618 19:57:19.676348 4626 sys_catalog.cc:263] Verifying existing consensus state
I20260618 19:57:19.677205 2682 external_mini_cluster.cc:1434] Started /tmp/dist-test-task_3iVrE/build/asan/bin/kudu as pid 4556
I20260618 19:57:19.680133 4626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: Bootstrap starting.
I20260618 19:57:19.694841 4626 log.cc:826] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: Log is configured to *not* fsync() on all Append() calls
I20260618 19:57:19.739862 4626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: Bootstrap replayed 1/1 log segments. Stats: ops{read=54 overwritten=0 applied=54 ignored=0} inserts{seen=35 ignored=0} mutations{seen=42 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260618 19:57:19.740485 4626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: Bootstrap complete.
I20260618 19:57:19.746289 4626 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:19.747105 4626 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0447960184714aaf886ca15b9aa0e63a, State: Initialized, Role: FOLLOWER
I20260618 19:57:19.747901 4626 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 54, Last appended: 6.54, Last appended by leader: 54, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:19.748775 4631 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:19.749059 4631 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: This master's current role is: FOLLOWER
I20260618 19:57:19.749984 4626 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: configured and running, proceeding with master startup.
I20260618 19:57:19.763446 4645 catalog_manager.cc:1294] Loaded cluster ID: 2cd457c38b944bab8903c2f58018327f
I20260618 19:57:19.763656 4645 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: loading cluster ID for follower catalog manager: success
I20260618 19:57:19.768276 4645 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: acquiring CA information for follower catalog manager: success
I20260618 19:57:19.771591 4645 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260618 19:57:19.778411 4556 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:57:19.782263 4556 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260618 19:57:19.843590 3375 heartbeater.cc:344] Connected to a master server at 127.2.158.189:45955
I20260618 19:57:19.844010 3514 heartbeater.cc:344] Connected to a master server at 127.2.158.189:45955
I20260618 19:57:19.846781 4590 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" instance_seqno: 1781812621902304) as {username='slave'} at 127.2.158.130:60399; Asking this server to re-register.
I20260618 19:57:19.846823 4591 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" instance_seqno: 1781812621349212) as {username='slave'} at 127.2.158.129:38053; Asking this server to re-register.
I20260618 19:57:19.847820 3514 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:19.848050 3375 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:19.849798 4590 ts_manager.cc:194] Registered new tserver with Master: 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483)
I20260618 19:57:19.849915 4591 ts_manager.cc:194] Registered new tserver with Master: 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205)
I20260618 19:57:19.942622 3658 heartbeater.cc:344] Connected to a master server at 127.2.158.189:45955
I20260618 19:57:19.944272 4590 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" instance_seqno: 1781812622463911) as {username='slave'} at 127.2.158.131:58265; Asking this server to re-register.
I20260618 19:57:19.944948 3658 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:19.946391 4590 ts_manager.cc:194] Registered new tserver with Master: 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:20.340442 4656 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:20.340736 4656 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:20.342644 4656 leader_election.cc:290] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975)
W20260618 19:57:20.343673 4575 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:57:20.346428 4577 leader_election.cc:336] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975): Network error: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111)
W20260618 19:57:20.346643 4575 leader_election.cc:336] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 19:57:20.346776 4575 leader_election.cc:304] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0447960184714aaf886ca15b9aa0e63a; no voters: 6c13c838eb85465090e1bff0df28912f, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:20.347095 4656 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260618 19:57:20.903743 4664 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:20.903939 4664 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:20.904865 4664 leader_election.cc:290] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975)
W20260618 19:57:20.907155 4575 leader_election.cc:336] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:57:20.907316 4577 leader_election.cc:336] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975): Network error: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111)
I20260618 19:57:20.907564 4577 leader_election.cc:304] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0447960184714aaf886ca15b9aa0e63a; no voters: 6c13c838eb85465090e1bff0df28912f, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:20.907835 4664 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260618 19:57:21.625661 4677 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:21.625839 4677 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:21.626670 4677 leader_election.cc:290] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975)
W20260618 19:57:21.629060 4575 leader_election.cc:336] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:57:21.629478 4577 leader_election.cc:336] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975): Network error: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111)
I20260618 19:57:21.629647 4577 leader_election.cc:304] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0447960184714aaf886ca15b9aa0e63a; no voters: 6c13c838eb85465090e1bff0df28912f, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:21.629889 4677 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260618 19:57:22.536257 4694 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:22.536458 4694 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:22.537570 4694 leader_election.cc:290] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975)
W20260618 19:57:22.540277 4575 leader_election.cc:336] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:57:22.540434 4577 leader_election.cc:336] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975): Network error: Client connection negotiation failed: client connection to 127.2.158.188:34975: connect: Connection refused (error 111)
I20260618 19:57:22.540623 4577 leader_election.cc:304] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0447960184714aaf886ca15b9aa0e63a; no voters: 6c13c838eb85465090e1bff0df28912f, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:22.540931 4694 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260618 19:57:22.706041 2682 external_mini_cluster.cc:1372] Running /tmp/dist-test-task_3iVrE/build/asan/bin/kudu
/tmp/dist-test-task_3iVrE/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.158.188:34975
--webserver_interface=127.2.158.188
--webserver_port=36245
--builtin_ntp_servers=127.2.158.148:40109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975
--hive_metastore_uris=thrift://127.0.0.1:43379
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260618 19:57:23.107514 4698 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 19:57:23.107864 4698 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 19:57:23.107959 4698 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260618 19:57:23.117413 4698 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 19:57:23.117511 4698 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260618 19:57:23.117566 4698 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 19:57:23.117605 4698 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260618 19:57:23.128044 4698 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.158.148:40109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:43379
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.158.188:34975
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.2.158.188
--webserver_port=36245
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 18 Jun 2026 19:43:24 UTC on bdcb31816ec0
build id 12458
ASAN enabled
I20260618 19:57:23.129637 4698 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 19:57:23.131480 4698 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260618 19:57:23.140126 4710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 19:57:23.140897 4711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 19:57:23.141664 4713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 19:57:23.142851 4698 server_base.cc:1061] running on GCE node
I20260618 19:57:23.143656 4698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 19:57:23.145192 4698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 19:57:23.146458 4698 hybrid_clock.cc:648] HybridClock initialized: now 1781812643146417 us; error 34 us; skew 500 ppm
I20260618 19:57:23.146852 4698 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260618 19:57:23.149034 4698 webserver.cc:533] Webserver started at http://127.2.158.188:36245/ using document root <none> and password file <none>
I20260618 19:57:23.149852 4698 fs_manager.cc:362] Metadata directory not provided
I20260618 19:57:23.149989 4698 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 19:57:23.155763 4698 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260618 19:57:23.159219 4719 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 19:57:23.160728 4698 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260618 19:57:23.161008 4698 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data,/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/wal
uuid: "6c13c838eb85465090e1bff0df28912f"
format_stamp: "Formatted at 2026-06-18 19:57:00 on dist-test-slave-6zlr"
I20260618 19:57:23.161855 4698 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 19:57:23.181571 4698 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 19:57:23.182785 4698 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 19:57:23.183089 4698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 19:57:23.204957 4698 rpc_server.cc:307] RPC server started. Bound to: 127.2.158.188:34975
I20260618 19:57:23.204993 4770 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.158.188:34975 every 8 connection(s)
I20260618 19:57:23.206849 4698 server_base.cc:1193] Dumped server information to /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data/info.pb
I20260618 19:57:23.208649 2682 external_mini_cluster.cc:1434] Started /tmp/dist-test-task_3iVrE/build/asan/bin/kudu as pid 4698
I20260618 19:57:23.214953 4771 sys_catalog.cc:263] Verifying existing consensus state
I20260618 19:57:23.218449 4771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: Bootstrap starting.
I20260618 19:57:23.232597 4771 log.cc:826] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: Log is configured to *not* fsync() on all Append() calls
I20260618 19:57:23.244161 3374 heartbeater.cc:344] Connected to a master server at 127.2.158.188:34975
I20260618 19:57:23.276190 4771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: Bootstrap replayed 1/1 log segments. Stats: ops{read=52 overwritten=1 applied=51 ignored=0} inserts{seen=33 ignored=0} mutations{seen=40 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260618 19:57:23.276893 4771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: Bootstrap complete.
I20260618 19:57:23.283922 4771 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 5 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:23.284767 4771 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c13c838eb85465090e1bff0df28912f, State: Initialized, Role: FOLLOWER
I20260618 19:57:23.285631 4771 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 51, Last appended: 5.51, Last appended by leader: 51, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:23.286572 4778 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:23.286911 4778 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: This master's current role is: FOLLOWER
I20260618 19:57:23.287784 4771 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: configured and running, proceeding with master startup.
I20260618 19:57:23.301936 4698 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:57:23.308784 4698 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260618 19:57:23.316636 4792 catalog_manager.cc:1294] Loaded cluster ID: 2cd457c38b944bab8903c2f58018327f
I20260618 19:57:23.316751 4792 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: loading cluster ID for follower catalog manager: success
I20260618 19:57:23.321355 4792 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: acquiring CA information for follower catalog manager: success
I20260618 19:57:23.324342 4792 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260618 19:57:23.349087 3513 heartbeater.cc:344] Connected to a master server at 127.2.158.188:34975
I20260618 19:57:23.351961 4736 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" instance_seqno: 1781812621902304) as {username='slave'} at 127.2.158.130:57241; Asking this server to re-register.
I20260618 19:57:23.352748 3513 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:23.354956 4736 ts_manager.cc:194] Registered new tserver with Master: 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483)
I20260618 19:57:23.453465 3657 heartbeater.cc:344] Connected to a master server at 127.2.158.188:34975
I20260618 19:57:23.453712 3657 heartbeater.cc:499] Master 127.2.158.188:34975 was elected leader, sending a full tablet report...
I20260618 19:57:23.456017 4736 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" instance_seqno: 1781812622463911) as {username='slave'} at 127.2.158.131:52709; Asking this server to re-register.
I20260618 19:57:23.456853 3657 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:23.458425 4736 ts_manager.cc:194] Registered new tserver with Master: 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:23.724942 4778 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:23.725260 4778 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:23.727452 4778 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:57:23.728600 4720 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:57:23.730355 4720 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 19:57:23.734611 4601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c13c838eb85465090e1bff0df28912f" candidate_term: 6 candidate_status { last_received { term: 5 index: 51 } } ignore_live_leader: false dest_uuid: "0447960184714aaf886ca15b9aa0e63a" is_pre_election: true
I20260618 19:57:23.735075 4601 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c13c838eb85465090e1bff0df28912f in current term 6: Already voted for candidate acc600e5aa44409ea3ce4c2861cb4de1 in this term.
I20260618 19:57:23.735898 4722 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:23.736294 4778 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 5 FOLLOWER]: Advancing to term 6
I20260618 19:57:23.740389 4778 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260618 19:57:23.748694 3374 heartbeater.cc:344] Connected to a master server at 127.2.158.188:34975
I20260618 19:57:23.750445 4736 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" instance_seqno: 1781812621349212) as {username='slave'} at 127.2.158.129:33011; Asking this server to re-register.
I20260618 19:57:23.751122 3374 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:23.752732 4736 ts_manager.cc:194] Registered new tserver with Master: 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205)
I20260618 19:57:24.346591 4806 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:24.346810 4806 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:24.347776 4806 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
I20260618 19:57:24.348910 4601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c13c838eb85465090e1bff0df28912f" candidate_term: 7 candidate_status { last_received { term: 5 index: 51 } } ignore_live_leader: false dest_uuid: "0447960184714aaf886ca15b9aa0e63a" is_pre_election: true
I20260618 19:57:24.349346 4601 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c13c838eb85465090e1bff0df28912f for term 7 because replica has last-logged OpId of term: 6 index: 54, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 51.
W20260618 19:57:24.350467 4720 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 19:57:24.350577 4720 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:24.350894 4806 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260618 19:57:24.436066 4810 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:24.436383 4810 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:24.437083 4810 leader_election.cc:290] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975)
W20260618 19:57:24.440258 4575 leader_election.cc:336] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 19:57:24.444334 4746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0447960184714aaf886ca15b9aa0e63a" candidate_term: 7 candidate_status { last_received { term: 6 index: 54 } } ignore_live_leader: false dest_uuid: "6c13c838eb85465090e1bff0df28912f" is_pre_election: true
I20260618 19:57:24.444801 4746 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0447960184714aaf886ca15b9aa0e63a in term 6.
I20260618 19:57:24.445549 4577 leader_election.cc:304] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0447960184714aaf886ca15b9aa0e63a, 6c13c838eb85465090e1bff0df28912f; no voters: acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:24.445922 4810 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260618 19:57:24.446079 4810 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 19:57:24.446208 4810 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 6 FOLLOWER]: Advancing to term 7
I20260618 19:57:24.450016 4810 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:24.450726 4810 leader_election.cc:290] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 election: Requested vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975)
I20260618 19:57:24.451380 4746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0447960184714aaf886ca15b9aa0e63a" candidate_term: 7 candidate_status { last_received { term: 6 index: 54 } } ignore_live_leader: false dest_uuid: "6c13c838eb85465090e1bff0df28912f"
I20260618 19:57:24.451594 4746 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 6 FOLLOWER]: Advancing to term 7
W20260618 19:57:24.451997 4575 leader_election.cc:336] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 19:57:24.453948 4746 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0447960184714aaf886ca15b9aa0e63a in term 7.
I20260618 19:57:24.454403 4577 leader_election.cc:304] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0447960184714aaf886ca15b9aa0e63a, 6c13c838eb85465090e1bff0df28912f; no voters: acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:24.454741 4810 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 7 FOLLOWER]: Leader election won for term 7
I20260618 19:57:24.455175 4810 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 7 LEADER]: Becoming Leader. State: Replica: 0447960184714aaf886ca15b9aa0e63a, State: Running, Role: LEADER
I20260618 19:57:24.455616 4810 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 54, Committed index: 54, Last appended: 6.54, Last appended by leader: 54, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:24.458446 4816 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0447960184714aaf886ca15b9aa0e63a. Latest consensus state: current_term: 7 leader_uuid: "0447960184714aaf886ca15b9aa0e63a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:24.458748 4816 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: This master's current role is: LEADER
I20260618 19:57:24.459417 4818 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260618 19:57:24.461930 4818 catalog_manager.cc:679] Loaded metadata for table default.table_28d033357fdb4b29b0abfeebb5ef122b [id=58a0cd369a884f1fb371a75c1794f738]
I20260618 19:57:24.462500 4818 catalog_manager.cc:679] Loaded metadata for table default.table_e1e6b231bd514a58a66b66d04eff6e48 [id=5a73fe372e7f47b49ed9219558f0194e]
I20260618 19:57:24.463011 4818 catalog_manager.cc:679] Loaded metadata for table default.table_4957212a0ca5452e98630b441906262f [id=749b241f59b34125a9ff8d7c847ddd3d]
I20260618 19:57:24.463460 4818 catalog_manager.cc:679] Loaded metadata for table default.table_4f9cd241b4284c4796f2aba3ccec0e35 [id=873b29232cab4ad9a9f8c070455c98a9]
I20260618 19:57:24.464190 4818 catalog_manager.cc:679] Loaded metadata for table default.table_77c95317631d4b1eab1943139e888ecb [id=aca591adc1fb402ca2dcd58765479d54]
I20260618 19:57:24.464653 4818 catalog_manager.cc:679] Loaded metadata for table default.table_b11e5cb8e5194655b89a8452d2eb25f5 [id=b3a217a305294496bd2ad3d3eed4e179]
I20260618 19:57:24.465216 4818 catalog_manager.cc:679] Loaded metadata for table default.table_8a3fffa237bc419e8921a2b75f70e639 [id=c256b56cd126492ea4f98f7d075e0a53]
I20260618 19:57:24.465693 4818 catalog_manager.cc:679] Loaded metadata for table default.table_736a38f9f9fe4dc7aed9092c9b7b33cb [id=e0eb4bb31ccb4cb58174534059e2ce81]
I20260618 19:57:24.466005 4818 catalog_manager.cc:679] Loaded metadata for table default.table_39c8f72f53c5475bb66b72b21bd13991 [id=e13d5a8056214b30b410b665b7184922]
I20260618 19:57:24.468163 4818 tablet_loader.cc:96] loaded metadata for tablet 182415f6a2c94b9fa32ae241aced8853 (table default.table_8a3fffa237bc419e8921a2b75f70e639 [id=c256b56cd126492ea4f98f7d075e0a53])
I20260618 19:57:24.468663 4818 tablet_loader.cc:96] loaded metadata for tablet 2ae7f1014ac3440d820a774c635badbe (table default.table_4f9cd241b4284c4796f2aba3ccec0e35 [id=873b29232cab4ad9a9f8c070455c98a9])
I20260618 19:57:24.468909 4818 tablet_loader.cc:96] loaded metadata for tablet 42b5d60c1e3e4323866ddd8e5b8881b6 (table default.table_77c95317631d4b1eab1943139e888ecb [id=aca591adc1fb402ca2dcd58765479d54])
I20260618 19:57:24.469376 4818 tablet_loader.cc:96] loaded metadata for tablet 48c932d095ea475abc03d02def7e9a27 (table default.table_28d033357fdb4b29b0abfeebb5ef122b [id=58a0cd369a884f1fb371a75c1794f738])
I20260618 19:57:24.470093 4818 tablet_loader.cc:96] loaded metadata for tablet 729a419e001f43b681075130b9543835 (table default.table_e1e6b231bd514a58a66b66d04eff6e48 [id=5a73fe372e7f47b49ed9219558f0194e])
I20260618 19:57:24.470324 4818 tablet_loader.cc:96] loaded metadata for tablet 83164978e2724f98ac65581b775089b9 (table default.table_4957212a0ca5452e98630b441906262f [id=749b241f59b34125a9ff8d7c847ddd3d])
I20260618 19:57:24.470557 4818 tablet_loader.cc:96] loaded metadata for tablet 8dd15a7fb224481593155899a99c249c (table default.table_39c8f72f53c5475bb66b72b21bd13991 [id=e13d5a8056214b30b410b665b7184922])
I20260618 19:57:24.471341 4818 tablet_loader.cc:96] loaded metadata for tablet bce5543840af43b7b9933eb585ceeb80 (table default.table_b11e5cb8e5194655b89a8452d2eb25f5 [id=b3a217a305294496bd2ad3d3eed4e179])
I20260618 19:57:24.471818 4818 tablet_loader.cc:96] loaded metadata for tablet e8cd3c16e63242b19971e1702d9ed961 (table default.table_736a38f9f9fe4dc7aed9092c9b7b33cb [id=e0eb4bb31ccb4cb58174534059e2ce81])
I20260618 19:57:24.472338 4818 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260618 19:57:24.473358 4818 catalog_manager.cc:1294] Loaded cluster ID: 2cd457c38b944bab8903c2f58018327f
I20260618 19:57:24.473433 4818 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260618 19:57:24.474613 4818 catalog_manager.cc:1539] Loading token signing keys...
I20260618 19:57:24.476114 4818 catalog_manager.cc:6080] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: Loaded TSK: 0
I20260618 19:57:24.477187 4818 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260618 19:57:24.478410 4818 catalog_manager.cc:1562] Loading latest processed Hive Metastore notification log event ID...
I20260618 19:57:24.479519 4818 catalog_manager.cc:5918] Last processed Hive Metastore notification event ID: -1
I20260618 19:57:24.552675 4590 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57692:
table { table_name: "default.Table_736a38f9f9fe4dc7aed9092c9b7b33cb" } modify_external_catalogs: true
I20260618 19:57:24.553045 4590 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57692:
table { table_name: "default.Table_736a38f9f9fe4dc7aed9092c9b7b33cb" } modify_external_catalogs: true
I20260618 19:57:24.552898 4591 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57692:
name: "default.Table_fa143415606c44cf80647e88be53822a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:24.554078 4586 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57692:
name: "default.Table_b536ea4ed5c945adb98d4d2c41448d70"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:24.554807 4585 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57692:
table { table_name: "default.Table_4957212a0ca5452e98630b441906262f" } new_table_name: "default.Table_972741ac692e4b0797a3406e734bb4d4" modify_external_catalogs: true
I20260618 19:57:24.555430 4583 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57692:
name: "default.Table_917e434e2f0140148e432b0324ad9763"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:24.555714 4582 master_service.cc:960] ReplaceTablet: received request to replace tablet f45d6e214bb646cdbf84ee1572859863 from {username='slave'} at 127.0.0.1:57692
I20260618 19:57:24.555344 4584 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57692:
table { table_name: "default.Table_b11e5cb8e5194655b89a8452d2eb25f5" } new_table_name: "default.Table_9fbf373ce2cc4af6949381c591b56ca1" modify_external_catalogs: true
I20260618 19:57:24.557412 4588 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57692:
table { table_name: "default.Table_39c8f72f53c5475bb66b72b21bd13991" } new_table_name: "default.Table_90f63258f4774ae884662efcb6a64fc3" modify_external_catalogs: true
I20260618 19:57:24.558943 4582 master_service.cc:960] ReplaceTablet: received request to replace tablet 15e541a8d092404eb2b2920893b94da3 from {username='slave'} at 127.0.0.1:57692
I20260618 19:57:24.559625 4582 master_service.cc:960] ReplaceTablet: received request to replace tablet 15e541a8d092404eb2b2920893b94da3 from {username='slave'} at 127.0.0.1:57692
I20260618 19:57:24.560071 4582 master_service.cc:960] ReplaceTablet: received request to replace tablet f45d6e214bb646cdbf84ee1572859863 from {username='slave'} at 127.0.0.1:57692
I20260618 19:57:24.560495 4582 master_service.cc:960] ReplaceTablet: received request to replace tablet f45d6e214bb646cdbf84ee1572859863 from {username='slave'} at 127.0.0.1:57692
I20260618 19:57:24.560985 4582 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57692:
table { table_name: "default.Table_28d033357fdb4b29b0abfeebb5ef122b" } modify_external_catalogs: true
I20260618 19:57:24.558262 4589 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57692:
name: "default.Table_9557e658e4484fffa051fe4e630478d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:24.558467 4587 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57692:
name: "default.Table_0975ad87638142ddbb8e4438fc9393a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:24.561702 4582 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57692:
table { table_name: "default.Table_28d033357fdb4b29b0abfeebb5ef122b" } modify_external_catalogs: true
F20260618 19:57:24.564961 4644 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 1, previous 1; dumping first 2 out of 10 received events: NotificationEvent(eventId=1, eventTime=1781812622, eventType=CREATE_TABLE, dbName=default, tableName=table_402627eeff7b4c338e64cfbe575411be, message={"server":"","servicePrincipal":"","db":"default","table":"table_402627eeff7b4c338e64cfbe575411be","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_402627eeff7b4c338e64cfbe575411be\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1781812622},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/warehouse/table_402627eeff7b4c338e64cfbe575411be\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_402627eeff7b4c338e64cfbe575411be\",\"kudu.table_id\":\"d0b8f5d092934582ab6ebf43cd6f9f6f\",\"transient_lastDdlTime\":\"1781812622\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"2cd457c38b944bab8903c2f58018327f\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1781812622,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=1, eventTime=1781812622, eventType=CREATE_TABLE, dbName=default, tableName=table_4957212a0ca5452e98630b441906262f, message={"server":"","servicePrincipal":"","db":"default","table":"table_4957212a0ca5452e98630b441906262f","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_4957212a0ca5452e98630b441906262f\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1781812622},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/warehouse/table_4957212a0ca5452e98630b441906262f\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_4957212a0ca5452e98630b441906262f\",\"kudu.table_id\":\"749b241f59b34125a9ff8d7c847ddd3d\",\"transient_lastDdlTime\":\"1781812622\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"2cd457c38b944bab8903c2f58018327f\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1781812622,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7f9cece6fdcd google::LogMessage::Fail() at ??:0
@ 0x7f9cece73b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f9cece6f7cc google::LogMessage::Flush() at ??:0
@ 0x7f9cece6fa11 google::LogMessage::~LogMessage() at ??:0
@ 0x7f9d03a6a394 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f9d03a68c41 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7f9d03a708bc kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7f9d03a70739 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa681d std::function<>::operator()() at ??:?
@ 0x7f9cefb96f49 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f9cf32606db start_thread at ??:0
@ 0x7f9cebd1e61f clone at ??:0
W20260618 19:57:24.779418 3668 connection.cc:573] client connection to 127.2.158.189:45955 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260618 19:57:24.780804 3668 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.2.158.189:45955)
W20260618 19:57:24.781427 3668 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.2.158.189:45955)
W20260618 19:57:24.781682 3668 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.2.158.189:45955)
W20260618 19:57:24.782007 3668 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.2.158.189:45955)
I20260618 19:57:25.623870 4835 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:25.624074 4835 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:25.624687 4835 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:57:25.627417 4722 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
W20260618 19:57:25.627627 4720 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 19:57:25.627753 4720 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:25.627961 4835 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260618 19:57:26.253980 4840 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:26.254247 4840 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:26.255158 4840 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:57:26.257900 4720 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:57:26.258230 4722 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 19:57:26.258332 4722 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:26.258569 4840 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260618 19:57:26.445163 2682 external_mini_cluster.cc:1372] Running /tmp/dist-test-task_3iVrE/build/asan/bin/kudu
/tmp/dist-test-task_3iVrE/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.158.189:45955
--webserver_interface=127.2.158.189
--webserver_port=36353
--builtin_ntp_servers=127.2.158.148:40109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975
--hive_metastore_uris=thrift://127.0.0.1:43379
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260618 19:57:26.815147 4844 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 19:57:26.815534 4844 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 19:57:26.815645 4844 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260618 19:57:26.827086 4844 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 19:57:26.827204 4844 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260618 19:57:26.827267 4844 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 19:57:26.827319 4844 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260618 19:57:26.839139 4844 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.158.148:40109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:43379
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.158.189:45955
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.2.158.189
--webserver_port=36353
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 18 Jun 2026 19:43:24 UTC on bdcb31816ec0
build id 12458
ASAN enabled
I20260618 19:57:26.840837 4844 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 19:57:26.842922 4844 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260618 19:57:26.851990 4850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 19:57:26.852011 4849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 19:57:26.852638 4852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 19:57:26.853328 4844 server_base.cc:1061] running on GCE node
I20260618 19:57:26.854182 4844 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 19:57:26.855701 4844 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 19:57:26.857010 4844 hybrid_clock.cc:648] HybridClock initialized: now 1781812646856980 us; error 51 us; skew 500 ppm
I20260618 19:57:26.857510 4844 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260618 19:57:26.859921 4844 webserver.cc:533] Webserver started at http://127.2.158.189:36353/ using document root <none> and password file <none>
I20260618 19:57:26.860707 4844 fs_manager.cc:362] Metadata directory not provided
I20260618 19:57:26.860841 4844 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 19:57:26.866490 4844 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260618 19:57:26.870045 4858 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 19:57:26.871774 4844 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260618 19:57:26.871961 4844 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/data,/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/wal
uuid: "0447960184714aaf886ca15b9aa0e63a"
format_stamp: "Formatted at 2026-06-18 19:56:59 on dist-test-slave-6zlr"
I20260618 19:57:26.872748 4844 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 19:57:26.914088 4844 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 19:57:26.914973 4844 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 19:57:26.915299 4844 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 19:57:26.941140 4844 rpc_server.cc:307] RPC server started. Bound to: 127.2.158.189:45955
I20260618 19:57:26.941179 4909 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.158.189:45955 every 8 connection(s)
I20260618 19:57:26.943439 4844 server_base.cc:1193] Dumped server information to /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-1/data/info.pb
I20260618 19:57:26.948356 2682 external_mini_cluster.cc:1434] Started /tmp/dist-test-task_3iVrE/build/asan/bin/kudu as pid 4844
I20260618 19:57:26.953230 4910 sys_catalog.cc:263] Verifying existing consensus state
I20260618 19:57:26.958607 4910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: Bootstrap starting.
I20260618 19:57:26.974830 4910 log.cc:826] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: Log is configured to *not* fsync() on all Append() calls
I20260618 19:57:26.982107 3658 heartbeater.cc:344] Connected to a master server at 127.2.158.189:45955
I20260618 19:57:27.025166 4910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: Bootstrap replayed 1/1 log segments. Stats: ops{read=55 overwritten=0 applied=54 ignored=0} inserts{seen=35 ignored=0} mutations{seen=42 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260618 19:57:27.025877 4910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: Bootstrap complete.
I20260618 19:57:27.029000 4915 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:27.029188 4915 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:27.029994 4915 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:57:27.032567 4720 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 19:57:27.034164 4910 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 7 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:27.035378 4910 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 7 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0447960184714aaf886ca15b9aa0e63a, State: Initialized, Role: FOLLOWER
I20260618 19:57:27.036319 4910 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 54, Last appended: 7.55, Last appended by leader: 55, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:27.037556 4919 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:27.037906 4919 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: This master's current role is: FOLLOWER
I20260618 19:57:27.038892 4910 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: configured and running, proceeding with master startup.
I20260618 19:57:27.038916 4885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c13c838eb85465090e1bff0df28912f" candidate_term: 8 candidate_status { last_received { term: 5 index: 51 } } ignore_live_leader: false dest_uuid: "0447960184714aaf886ca15b9aa0e63a" is_pre_election: true
I20260618 19:57:27.039572 4885 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c13c838eb85465090e1bff0df28912f for term 8 because replica has last-logged OpId of term: 7 index: 55, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 51.
I20260618 19:57:27.040319 4722 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:27.040706 4915 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260618 19:57:27.054519 4844 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:57:27.062301 4844 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260618 19:57:27.063266 4933 catalog_manager.cc:1294] Loaded cluster ID: 2cd457c38b944bab8903c2f58018327f
I20260618 19:57:27.063370 4933 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: loading cluster ID for follower catalog manager: success
I20260618 19:57:27.067974 4933 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: acquiring CA information for follower catalog manager: success
I20260618 19:57:27.070946 4933 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260618 19:57:27.387394 3375 heartbeater.cc:344] Connected to a master server at 127.2.158.189:45955
I20260618 19:57:27.387557 3514 heartbeater.cc:344] Connected to a master server at 127.2.158.189:45955
I20260618 19:57:27.390111 4874 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" instance_seqno: 1781812621349212) as {username='slave'} at 127.2.158.129:48113; Asking this server to re-register.
I20260618 19:57:27.390064 4875 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" instance_seqno: 1781812621902304) as {username='slave'} at 127.2.158.130:44983; Asking this server to re-register.
I20260618 19:57:27.390815 3375 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:27.391027 3514 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:27.392915 4874 ts_manager.cc:194] Registered new tserver with Master: 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483)
I20260618 19:57:27.392997 4875 ts_manager.cc:194] Registered new tserver with Master: 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205)
I20260618 19:57:27.486999 4875 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" instance_seqno: 1781812622463911) as {username='slave'} at 127.2.158.131:52475; Asking this server to re-register.
I20260618 19:57:27.487663 3658 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:27.489356 4875 ts_manager.cc:194] Registered new tserver with Master: 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:27.538640 4938 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:27.538928 4938 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:27.540977 4938 leader_election.cc:290] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975)
W20260618 19:57:27.542240 4859 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:57:27.544037 4859 leader_election.cc:336] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 19:57:27.547947 4746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0447960184714aaf886ca15b9aa0e63a" candidate_term: 8 candidate_status { last_received { term: 7 index: 55 } } ignore_live_leader: false dest_uuid: "6c13c838eb85465090e1bff0df28912f" is_pre_election: true
I20260618 19:57:27.548205 4746 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0447960184714aaf886ca15b9aa0e63a in term 7.
I20260618 19:57:27.548810 4861 leader_election.cc:304] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0447960184714aaf886ca15b9aa0e63a, 6c13c838eb85465090e1bff0df28912f; no voters: acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:27.549160 4938 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260618 19:57:27.549320 4938 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 19:57:27.549435 4938 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 7 FOLLOWER]: Advancing to term 8
I20260618 19:57:27.552882 4938 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:27.553607 4938 leader_election.cc:290] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 8 election: Requested vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 6c13c838eb85465090e1bff0df28912f (127.2.158.188:34975)
I20260618 19:57:27.554126 4746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0447960184714aaf886ca15b9aa0e63a" candidate_term: 8 candidate_status { last_received { term: 7 index: 55 } } ignore_live_leader: false dest_uuid: "6c13c838eb85465090e1bff0df28912f"
I20260618 19:57:27.554392 4746 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 7 FOLLOWER]: Advancing to term 8
W20260618 19:57:27.555097 4859 leader_election.cc:336] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 19:57:27.556352 4746 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0447960184714aaf886ca15b9aa0e63a in term 8.
I20260618 19:57:27.557119 4861 leader_election.cc:304] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0447960184714aaf886ca15b9aa0e63a, 6c13c838eb85465090e1bff0df28912f; no voters: acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:27.557654 4938 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 8 FOLLOWER]: Leader election won for term 8
I20260618 19:57:27.558202 4938 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [term 8 LEADER]: Becoming Leader. State: Replica: 0447960184714aaf886ca15b9aa0e63a, State: Running, Role: LEADER
I20260618 19:57:27.558704 4938 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 54, Committed index: 54, Last appended: 7.55, Last appended by leader: 55, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:27.562390 4942 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0447960184714aaf886ca15b9aa0e63a. Latest consensus state: current_term: 8 leader_uuid: "0447960184714aaf886ca15b9aa0e63a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:27.562696 4942 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [sys.catalog]: This master's current role is: LEADER
I20260618 19:57:27.563462 4944 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260618 19:57:27.566036 4944 catalog_manager.cc:679] Loaded metadata for table default.table_28d033357fdb4b29b0abfeebb5ef122b [id=58a0cd369a884f1fb371a75c1794f738]
I20260618 19:57:27.566430 4944 catalog_manager.cc:679] Loaded metadata for table default.table_e1e6b231bd514a58a66b66d04eff6e48 [id=5a73fe372e7f47b49ed9219558f0194e]
I20260618 19:57:27.566757 4944 catalog_manager.cc:679] Loaded metadata for table default.table_4957212a0ca5452e98630b441906262f [id=749b241f59b34125a9ff8d7c847ddd3d]
I20260618 19:57:27.567157 4944 catalog_manager.cc:679] Loaded metadata for table default.table_4f9cd241b4284c4796f2aba3ccec0e35 [id=873b29232cab4ad9a9f8c070455c98a9]
I20260618 19:57:27.567456 4944 catalog_manager.cc:679] Loaded metadata for table default.table_77c95317631d4b1eab1943139e888ecb [id=aca591adc1fb402ca2dcd58765479d54]
I20260618 19:57:27.567792 4944 catalog_manager.cc:679] Loaded metadata for table default.table_b11e5cb8e5194655b89a8452d2eb25f5 [id=b3a217a305294496bd2ad3d3eed4e179]
I20260618 19:57:27.568068 4944 catalog_manager.cc:679] Loaded metadata for table default.table_8a3fffa237bc419e8921a2b75f70e639 [id=c256b56cd126492ea4f98f7d075e0a53]
I20260618 19:57:27.568359 4944 catalog_manager.cc:679] Loaded metadata for table default.table_736a38f9f9fe4dc7aed9092c9b7b33cb [id=e0eb4bb31ccb4cb58174534059e2ce81]
I20260618 19:57:27.568626 4944 catalog_manager.cc:679] Loaded metadata for table default.table_39c8f72f53c5475bb66b72b21bd13991 [id=e13d5a8056214b30b410b665b7184922]
I20260618 19:57:27.570515 4944 tablet_loader.cc:96] loaded metadata for tablet 182415f6a2c94b9fa32ae241aced8853 (table default.table_8a3fffa237bc419e8921a2b75f70e639 [id=c256b56cd126492ea4f98f7d075e0a53])
I20260618 19:57:27.570923 4944 tablet_loader.cc:96] loaded metadata for tablet 2ae7f1014ac3440d820a774c635badbe (table default.table_4f9cd241b4284c4796f2aba3ccec0e35 [id=873b29232cab4ad9a9f8c070455c98a9])
I20260618 19:57:27.571162 4944 tablet_loader.cc:96] loaded metadata for tablet 42b5d60c1e3e4323866ddd8e5b8881b6 (table default.table_77c95317631d4b1eab1943139e888ecb [id=aca591adc1fb402ca2dcd58765479d54])
I20260618 19:57:27.571548 4944 tablet_loader.cc:96] loaded metadata for tablet 48c932d095ea475abc03d02def7e9a27 (table default.table_28d033357fdb4b29b0abfeebb5ef122b [id=58a0cd369a884f1fb371a75c1794f738])
I20260618 19:57:27.572197 4944 tablet_loader.cc:96] loaded metadata for tablet 729a419e001f43b681075130b9543835 (table default.table_e1e6b231bd514a58a66b66d04eff6e48 [id=5a73fe372e7f47b49ed9219558f0194e])
I20260618 19:57:27.572419 4944 tablet_loader.cc:96] loaded metadata for tablet 83164978e2724f98ac65581b775089b9 (table default.table_4957212a0ca5452e98630b441906262f [id=749b241f59b34125a9ff8d7c847ddd3d])
I20260618 19:57:27.572659 4944 tablet_loader.cc:96] loaded metadata for tablet 8dd15a7fb224481593155899a99c249c (table default.table_39c8f72f53c5475bb66b72b21bd13991 [id=e13d5a8056214b30b410b665b7184922])
I20260618 19:57:27.573953 4944 tablet_loader.cc:96] loaded metadata for tablet bce5543840af43b7b9933eb585ceeb80 (table default.table_b11e5cb8e5194655b89a8452d2eb25f5 [id=b3a217a305294496bd2ad3d3eed4e179])
I20260618 19:57:27.574442 4944 tablet_loader.cc:96] loaded metadata for tablet e8cd3c16e63242b19971e1702d9ed961 (table default.table_736a38f9f9fe4dc7aed9092c9b7b33cb [id=e0eb4bb31ccb4cb58174534059e2ce81])
I20260618 19:57:27.574972 4944 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260618 19:57:27.575934 4944 catalog_manager.cc:1294] Loaded cluster ID: 2cd457c38b944bab8903c2f58018327f
I20260618 19:57:27.576007 4944 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260618 19:57:27.577112 4944 catalog_manager.cc:1539] Loading token signing keys...
I20260618 19:57:27.577994 4944 catalog_manager.cc:6080] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: Loaded TSK: 0
I20260618 19:57:27.578902 4944 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260618 19:57:27.579774 4944 catalog_manager.cc:1562] Loading latest processed Hive Metastore notification log event ID...
I20260618 19:57:27.580549 4944 catalog_manager.cc:5918] Last processed Hive Metastore notification event ID: -1
I20260618 19:57:27.601375 4874 master_service.cc:960] ReplaceTablet: received request to replace tablet 182415f6a2c94b9fa32ae241aced8853 from {username='slave'} at 127.0.0.1:46122
I20260618 19:57:27.601543 4873 master_service.cc:960] ReplaceTablet: received request to replace tablet bce5543840af43b7b9933eb585ceeb80 from {username='slave'} at 127.0.0.1:46122
I20260618 19:57:27.601809 4875 master_service.cc:960] ReplaceTablet: received request to replace tablet 83164978e2724f98ac65581b775089b9 from {username='slave'} at 127.0.0.1:46122
I20260618 19:57:27.603693 4871 master_service.cc:960] ReplaceTablet: received request to replace tablet 83164978e2724f98ac65581b775089b9 from {username='slave'} at 127.0.0.1:46122
I20260618 19:57:27.603780 4868 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46122:
table { table_name: "default.Table_e1e6b231bd514a58a66b66d04eff6e48" } new_table_name: "default.Table_796d5677d78149a99894d70ce226919d" modify_external_catalogs: true
I20260618 19:57:27.605046 4867 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46122:
table { table_name: "default.Table_77c95317631d4b1eab1943139e888ecb" } modify_external_catalogs: true
I20260618 19:57:27.606253 4872 master_service.cc:960] ReplaceTablet: received request to replace tablet f45d6e214bb646cdbf84ee1572859863 from {username='slave'} at 127.0.0.1:46122
I20260618 19:57:27.607450 4870 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46122:
table { table_name: "default.Table_4f9cd241b4284c4796f2aba3ccec0e35" } new_table_name: "default.Table_09ffd657f7864eb4a23acb264281460c" modify_external_catalogs: true
I20260618 19:57:27.607372 4869 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46122:
name: "default.Table_0711d10accfd429788e8e459cacc6139"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:27.608436 4867 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46122:
table { table_name: "default.Table_77c95317631d4b1eab1943139e888ecb" } modify_external_catalogs: true
I20260618 19:57:27.610536 4872 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46122:
name: "default.Table_131e341c9bb840f7860a9fcaf6a2ec23"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:27.607863 4866 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46122:
name: "default.Table_3354ed02c5b4402089d56d478de4d48b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 19:57:27.615928 4746 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Refusing update from remote peer 0447960184714aaf886ca15b9aa0e63a: Log matching property violated. Preceding OpId in replica: term: 5 index: 51. Preceding OpId from leader: term: 8 index: 57. (index mismatch)
I20260618 19:57:27.616746 4938 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 56, Last known committed idx: 51, Time since last communication: 0.000s
W20260618 19:57:27.618781 4859 consensus_peers.cc:597] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a -> Peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Couldn't send request to peer acc600e5aa44409ea3ce4c2861cb4de1. Status: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
F20260618 19:57:27.619020 4932 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 1, previous 1; dumping first 2 out of 10 received events: NotificationEvent(eventId=1, eventTime=1781812622, eventType=CREATE_TABLE, dbName=default, tableName=table_402627eeff7b4c338e64cfbe575411be, message={"server":"","servicePrincipal":"","db":"default","table":"table_402627eeff7b4c338e64cfbe575411be","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_402627eeff7b4c338e64cfbe575411be\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1781812622},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/warehouse/table_402627eeff7b4c338e64cfbe575411be\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_402627eeff7b4c338e64cfbe575411be\",\"kudu.table_id\":\"d0b8f5d092934582ab6ebf43cd6f9f6f\",\"transient_lastDdlTime\":\"1781812622\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"2cd457c38b944bab8903c2f58018327f\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1781812622,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=1, eventTime=1781812622, eventType=CREATE_TABLE, dbName=default, tableName=table_4957212a0ca5452e98630b441906262f, message={"server":"","servicePrincipal":"","db":"default","table":"table_4957212a0ca5452e98630b441906262f","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_4957212a0ca5452e98630b441906262f\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1781812622},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/warehouse/table_4957212a0ca5452e98630b441906262f\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_4957212a0ca5452e98630b441906262f\",\"kudu.table_id\":\"749b241f59b34125a9ff8d7c847ddd3d\",\"transient_lastDdlTime\":\"1781812622\",\"comment\":\"\",\"kudu.master_addresses\":\"127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"2cd457c38b944bab8903c2f58018327f\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1781812622,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7f5341341dcd google::LogMessage::Fail() at ??:0
@ 0x7f5341345b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f53413417cc google::LogMessage::Flush() at ??:0
@ 0x7f5341341a11 google::LogMessage::~LogMessage() at ??:0
@ 0x7f5357f3c394 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260618 19:57:27.634214 4946 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0447960184714aaf886ca15b9aa0e63a. Latest consensus state: current_term: 8 leader_uuid: "0447960184714aaf886ca15b9aa0e63a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:27.634537 4946 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: This master's current role is: FOLLOWER
I20260618 19:57:27.634992 4945 mvcc.cc:204] Tried to move back new op lower bound from 7298304604625584128 to 7298304591693656064. Current Snapshot: MvccSnapshot[applied={T|T < 7298304604625584128}]
I20260618 19:57:27.634904 4951 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "0447960184714aaf886ca15b9aa0e63a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:27.635214 4951 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: This master's current role is: FOLLOWER
I20260618 19:57:27.635946 4948 mvcc.cc:204] Tried to move back new op lower bound from 7298304604631228416 to 7298304591693656064. Current Snapshot: MvccSnapshot[applied={T|T < 7298304604625584128}]
I20260618 19:57:27.641448 4946 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "0447960184714aaf886ca15b9aa0e63a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:27.641685 4946 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: This master's current role is: FOLLOWER
I20260618 19:57:27.642023 4951 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "0447960184714aaf886ca15b9aa0e63a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:27.642198 4951 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7f5357f3ac41 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260618 19:57:27.657904 4874 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: Sending DeleteTablet for 3 replicas of tablet 182415f6a2c94b9fa32ae241aced8853
I20260618 19:57:27.661428 4873 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: Sending DeleteTablet for 3 replicas of tablet bce5543840af43b7b9933eb585ceeb80
I20260618 19:57:27.662302 4873 catalog_manager.cc:6784] ReplaceTablet: tablet bce5543840af43b7b9933eb585ceeb80 deleted and replaced by tablet 4ce03301eebd4d1a847466b8350fcfc2
@ 0x7f5357f428bc kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260618 19:57:27.663380 4875 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 0447960184714aaf886ca15b9aa0e63a: Sending DeleteTablet for 3 replicas of tablet 83164978e2724f98ac65581b775089b9
I20260618 19:57:27.663939 4875 catalog_manager.cc:6784] ReplaceTablet: tablet 83164978e2724f98ac65581b775089b9 deleted and replaced by tablet 3e5ca886927c468c84a7f517d6e81ca9
@ 0x7f5357f42739 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa681d std::function<>::operator()() at ??:?
I20260618 19:57:27.671928 4874 catalog_manager.cc:6784] ReplaceTablet: tablet 182415f6a2c94b9fa32ae241aced8853 deleted and replaced by tablet 3c53e388f5ee4e14bccb8007ea965b83
@ 0x7f5344068f49 kudu::Thread::SuperviseThread() at ??:0
I20260618 19:57:27.678674 3588 tablet_service.cc:1558] Processing DeleteTablet for tablet bce5543840af43b7b9933eb585ceeb80 with delete_type TABLET_DATA_DELETED (replaced by tablet 4ce03301eebd4d1a847466b8350fcfc2) from {username='slave'} at 127.0.0.1:49100
I20260618 19:57:27.679279 3590 tablet_service.cc:1558] Processing DeleteTablet for tablet 83164978e2724f98ac65581b775089b9 with delete_type TABLET_DATA_DELETED (replaced by tablet 3e5ca886927c468c84a7f517d6e81ca9) from {username='slave'} at 127.0.0.1:49100
I20260618 19:57:27.679543 3589 tablet_service.cc:1558] Processing DeleteTablet for tablet 182415f6a2c94b9fa32ae241aced8853 with delete_type TABLET_DATA_DELETED (replaced by tablet 3c53e388f5ee4e14bccb8007ea965b83) from {username='slave'} at 127.0.0.1:49100
@ 0x7f53477326db start_thread at ??:0
I20260618 19:57:27.680569 4967 tablet_replica.cc:333] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: stopping tablet replica
I20260618 19:57:27.681169 4967 raft_consensus.cc:2243] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 LEADER]: Raft consensus shutting down.
I20260618 19:57:27.681615 4967 raft_consensus.cc:2272] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Raft consensus is shut down!
@ 0x7f53401f061f clone at ??:0
I20260618 19:57:27.683823 4967 ts_tablet_manager.cc:1916] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:27.691253 4967 ts_tablet_manager.cc:1929] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:27.691411 4967 log.cc:1199] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/wal/wals/bce5543840af43b7b9933eb585ceeb80
I20260618 19:57:27.692255 4967 ts_tablet_manager.cc:1950] T bce5543840af43b7b9933eb585ceeb80 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting consensus metadata
I20260618 19:57:27.693614 4967 tablet_replica.cc:333] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: stopping tablet replica
I20260618 19:57:27.693833 4967 raft_consensus.cc:2243] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 LEADER]: Raft consensus shutting down.
I20260618 19:57:27.694156 4967 raft_consensus.cc:2272] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:27.694826 4967 ts_tablet_manager.cc:1916] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:27.702178 4967 ts_tablet_manager.cc:1929] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:27.702329 4967 log.cc:1199] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/wal/wals/83164978e2724f98ac65581b775089b9
I20260618 19:57:27.702802 4967 ts_tablet_manager.cc:1950] T 83164978e2724f98ac65581b775089b9 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting consensus metadata
I20260618 19:57:27.703898 4967 tablet_replica.cc:333] T 182415f6a2c94b9fa32ae241aced8853 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: stopping tablet replica
I20260618 19:57:27.704113 4967 raft_consensus.cc:2243] T 182415f6a2c94b9fa32ae241aced8853 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 19:57:27.704315 4967 raft_consensus.cc:2272] T 182415f6a2c94b9fa32ae241aced8853 P 6bb3ca8239f4412fb8b0e7d0df9e50c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 19:57:27.704937 4967 ts_tablet_manager.cc:1916] T 182415f6a2c94b9fa32ae241aced8853 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 19:57:27.712227 4967 ts_tablet_manager.cc:1929] T 182415f6a2c94b9fa32ae241aced8853 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260618 19:57:27.712373 4967 log.cc:1199] T 182415f6a2c94b9fa32ae241aced8853 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting WAL directory at /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/ts-2/wal/wals/182415f6a2c94b9fa32ae241aced8853
I20260618 19:57:27.712783 4967 ts_tablet_manager.cc:1950] T 182415f6a2c94b9fa32ae241aced8853 P 6bb3ca8239f4412fb8b0e7d0df9e50c1: Deleting consensus metadata
W20260618 19:57:27.863518 3544 connection.cc:573] server connection from 127.0.0.1:49100 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260618 19:57:27.864104 4963 negotiation.cc:336] Failed RPC negotiation. Trace:
0618 19:57:27.662114 (+ 0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:40408 (local address 127.2.158.129:44205)
0618 19:57:27.679034 (+ 16920us) server_negotiation.cc:207] Beginning negotiation
0618 19:57:27.679040 (+ 6us) server_negotiation.cc:400] Waiting for connection header
0618 19:57:27.679059 (+ 19us) server_negotiation.cc:408] Connection header received
0618 19:57:27.679130 (+ 71us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0618 19:57:27.679135 (+ 5us) server_negotiation.cc:462] Received NEGOTIATE request from client
0618 19:57:27.679212 (+ 77us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0618 19:57:27.679322 (+ 110us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
0618 19:57:27.681837 (+ 2515us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
0618 19:57:27.684693 (+ 2856us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
0618 19:57:27.863732 (+179039us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40408: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":16797,"thread_start_us":16693,"threads_started":1}
W20260618 19:57:27.864130 4962 negotiation.cc:336] Failed RPC negotiation. Trace:
0618 19:57:27.661830 (+ 0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:36392 (local address 127.2.158.130:34483)
0618 19:57:27.678436 (+ 16606us) server_negotiation.cc:207] Beginning negotiation
0618 19:57:27.678446 (+ 10us) server_negotiation.cc:400] Waiting for connection header
0618 19:57:27.679544 (+ 1098us) server_negotiation.cc:408] Connection header received
0618 19:57:27.679618 (+ 74us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0618 19:57:27.679623 (+ 5us) server_negotiation.cc:462] Received NEGOTIATE request from client
0618 19:57:27.679695 (+ 72us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0618 19:57:27.681377 (+ 1682us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
0618 19:57:27.682104 (+ 727us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
0618 19:57:27.684632 (+ 2528us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
0618 19:57:27.863732 (+179100us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36392: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":16450,"thread_start_us":16347,"threads_started":1}
W20260618 19:57:27.864583 3668 connection.cc:573] client connection to 127.2.158.189:45955 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260618 19:57:27.865190 3668 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.2.158.189:45955)
W20260618 19:57:27.865538 3668 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.2.158.189:45955)
W20260618 19:57:27.865851 3668 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.2.158.189:45955)
W20260618 19:57:27.866053 3668 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.2.158.189:45955)
I20260618 19:57:28.136458 4951 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0447960184714aaf886ca15b9aa0e63a)
I20260618 19:57:28.136658 4951 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:28.137374 4951 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:57:28.140197 4720 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:57:28.140389 4722 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 19:57:28.140522 4722 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:28.140837 4951 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260618 19:57:28.310041 4698 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:57:28.310252 4698 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260618 19:57:28.842104 4981 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0447960184714aaf886ca15b9aa0e63a)
I20260618 19:57:28.842337 4981 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:28.843004 4981 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:57:28.844244 4722 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111) [suppressed 8 similar messages]
W20260618 19:57:28.845706 4722 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
W20260618 19:57:28.845875 4720 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 19:57:28.846017 4720 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:28.846261 4981 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260618 19:57:28.870726 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 1: this message will repeat every 5th retry.
I20260618 19:57:29.567795 2682 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task_3iVrE/build/asan/bin/kudu pid 4698
I20260618 19:57:29.574841 4766 generic_service.cc:196] Checking for leaks (request via RPC)
I20260618 19:57:29.693513 2682 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task_3iVrE/build/asan/bin/kudu with pid 4698
I20260618 19:57:29.776465 4980 raft_consensus.cc:493] T bce5543840af43b7b9933eb585ceeb80 P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6bb3ca8239f4412fb8b0e7d0df9e50c1)
I20260618 19:57:29.776751 4980 raft_consensus.cc:515] T bce5543840af43b7b9933eb585ceeb80 P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:29.777681 4980 leader_election.cc:290] T bce5543840af43b7b9933eb585ceeb80 P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:29.778425 3327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce5543840af43b7b9933eb585ceeb80" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7" is_pre_election: true
W20260618 19:57:29.778900 3403 leader_election.cc:343] T bce5543840af43b7b9933eb585ceeb80 P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80
I20260618 19:57:29.779232 3402 leader_election.cc:304] T bce5543840af43b7b9933eb585ceeb80 P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 722df47a60ca4bfa82104dea57718f3b; no voters: 51c7777f264b496a9bf9511966dcfbd7, 6bb3ca8239f4412fb8b0e7d0df9e50c1
I20260618 19:57:29.779572 4991 raft_consensus.cc:2749] T bce5543840af43b7b9933eb585ceeb80 P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260618 19:57:29.863765 4985 raft_consensus.cc:493] T 83164978e2724f98ac65581b775089b9 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6bb3ca8239f4412fb8b0e7d0df9e50c1)
I20260618 19:57:29.864059 4985 raft_consensus.cc:515] T 83164978e2724f98ac65581b775089b9 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:29.864948 4985 leader_election.cc:290] T 83164978e2724f98ac65581b775089b9 P 51c7777f264b496a9bf9511966dcfbd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483), 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:29.865779 3466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83164978e2724f98ac65581b775089b9" candidate_uuid: "51c7777f264b496a9bf9511966dcfbd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "722df47a60ca4bfa82104dea57718f3b" is_pre_election: true
W20260618 19:57:29.866516 3264 leader_election.cc:343] T 83164978e2724f98ac65581b775089b9 P 51c7777f264b496a9bf9511966dcfbd7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Not found: Tablet not found: 83164978e2724f98ac65581b775089b9
I20260618 19:57:29.866856 3264 leader_election.cc:304] T 83164978e2724f98ac65581b775089b9 P 51c7777f264b496a9bf9511966dcfbd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7; no voters: 6bb3ca8239f4412fb8b0e7d0df9e50c1, 722df47a60ca4bfa82104dea57718f3b
I20260618 19:57:29.867153 4985 raft_consensus.cc:2749] T 83164978e2724f98ac65581b775089b9 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260618 19:57:30.403225 4985 raft_consensus.cc:493] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6bb3ca8239f4412fb8b0e7d0df9e50c1)
I20260618 19:57:30.403504 4985 raft_consensus.cc:515] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:30.404259 4985 leader_election.cc:290] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483), 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:30.404803 3466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce5543840af43b7b9933eb585ceeb80" candidate_uuid: "51c7777f264b496a9bf9511966dcfbd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "722df47a60ca4bfa82104dea57718f3b" is_pre_election: true
I20260618 19:57:30.405108 3466 raft_consensus.cc:2468] T bce5543840af43b7b9933eb585ceeb80 P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51c7777f264b496a9bf9511966dcfbd7 in term 1.
W20260618 19:57:30.405191 3264 leader_election.cc:343] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80
I20260618 19:57:30.405628 3264 leader_election.cc:304] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7, 722df47a60ca4bfa82104dea57718f3b; no voters: 6bb3ca8239f4412fb8b0e7d0df9e50c1
I20260618 19:57:30.406090 4985 raft_consensus.cc:2804] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260618 19:57:30.406234 4985 raft_consensus.cc:493] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6bb3ca8239f4412fb8b0e7d0df9e50c1)
I20260618 19:57:30.406354 4985 raft_consensus.cc:3060] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Advancing to term 2
I20260618 19:57:30.408257 4985 raft_consensus.cc:515] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:30.408835 4985 leader_election.cc:290] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 [CANDIDATE]: Term 2 election: Requested vote from peers 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483), 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:30.410189 2682 external_mini_cluster.cc:1372] Running /tmp/dist-test-task_3iVrE/build/asan/bin/kudu
/tmp/dist-test-task_3iVrE/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.158.188:34975
--webserver_interface=127.2.158.188
--webserver_port=36245
--builtin_ntp_servers=127.2.158.148:40109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975
--hive_metastore_uris=thrift://127.0.0.1:43379
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260618 19:57:30.410622 3466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce5543840af43b7b9933eb585ceeb80" candidate_uuid: "51c7777f264b496a9bf9511966dcfbd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "722df47a60ca4bfa82104dea57718f3b"
I20260618 19:57:30.410943 3466 raft_consensus.cc:3060] T bce5543840af43b7b9933eb585ceeb80 P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Advancing to term 2
W20260618 19:57:30.410915 3264 leader_election.cc:343] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80
I20260618 19:57:30.415184 3466 raft_consensus.cc:2468] T bce5543840af43b7b9933eb585ceeb80 P 722df47a60ca4bfa82104dea57718f3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51c7777f264b496a9bf9511966dcfbd7 in term 2.
I20260618 19:57:30.415921 3264 leader_election.cc:304] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7, 722df47a60ca4bfa82104dea57718f3b; no voters: 6bb3ca8239f4412fb8b0e7d0df9e50c1
I20260618 19:57:30.416330 4985 raft_consensus.cc:2804] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260618 19:57:30.416816 4985 raft_consensus.cc:697] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 [term 2 LEADER]: Becoming Leader. State: Replica: 51c7777f264b496a9bf9511966dcfbd7, State: Running, Role: LEADER
I20260618 19:57:30.417222 4985 consensus_queue.cc:237] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:30.683662 5005 raft_consensus.cc:493] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6bb3ca8239f4412fb8b0e7d0df9e50c1)
I20260618 19:57:30.684016 5005 raft_consensus.cc:515] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:30.685082 5005 leader_election.cc:290] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:30.685820 3327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83164978e2724f98ac65581b775089b9" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7" is_pre_election: true
I20260618 19:57:30.686134 3327 raft_consensus.cc:2468] T 83164978e2724f98ac65581b775089b9 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 722df47a60ca4bfa82104dea57718f3b in term 1.
W20260618 19:57:30.686476 3403 leader_election.cc:343] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Not found: Tablet not found: 83164978e2724f98ac65581b775089b9
I20260618 19:57:30.686698 3403 leader_election.cc:304] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7, 722df47a60ca4bfa82104dea57718f3b; no voters: 6bb3ca8239f4412fb8b0e7d0df9e50c1
I20260618 19:57:30.687158 5005 raft_consensus.cc:2804] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260618 19:57:30.687356 5005 raft_consensus.cc:493] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6bb3ca8239f4412fb8b0e7d0df9e50c1)
I20260618 19:57:30.687508 5005 raft_consensus.cc:3060] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b [term 1 FOLLOWER]: Advancing to term 2
I20260618 19:57:30.691179 5005 raft_consensus.cc:515] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
I20260618 19:57:30.692118 5005 leader_election.cc:290] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 2 election: Requested vote from peers 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205), 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:30.692745 3327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83164978e2724f98ac65581b775089b9" candidate_uuid: "722df47a60ca4bfa82104dea57718f3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51c7777f264b496a9bf9511966dcfbd7"
I20260618 19:57:30.693014 3327 raft_consensus.cc:3060] T 83164978e2724f98ac65581b775089b9 P 51c7777f264b496a9bf9511966dcfbd7 [term 1 FOLLOWER]: Advancing to term 2
W20260618 19:57:30.693239 3403 leader_election.cc:343] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Not found: Tablet not found: 83164978e2724f98ac65581b775089b9
I20260618 19:57:30.695219 3327 raft_consensus.cc:2468] T 83164978e2724f98ac65581b775089b9 P 51c7777f264b496a9bf9511966dcfbd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 722df47a60ca4bfa82104dea57718f3b in term 2.
I20260618 19:57:30.696141 3402 leader_election.cc:304] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51c7777f264b496a9bf9511966dcfbd7, 722df47a60ca4bfa82104dea57718f3b; no voters: 6bb3ca8239f4412fb8b0e7d0df9e50c1
I20260618 19:57:30.696738 5005 raft_consensus.cc:2804] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b [term 2 FOLLOWER]: Leader election won for term 2
I20260618 19:57:30.696959 5005 raft_consensus.cc:697] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b [term 2 LEADER]: Becoming Leader. State: Replica: 722df47a60ca4bfa82104dea57718f3b, State: Running, Role: LEADER
I20260618 19:57:30.697443 5005 consensus_queue.cc:237] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 } } peers { permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 } } peers { permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" member_type: VOTER last_known_addr { host: "127.2.158.131" port: 33071 } }
W20260618 19:57:30.802649 4998 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 19:57:30.802985 4998 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 19:57:30.803057 4998 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260618 19:57:30.811928 4998 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 19:57:30.812053 4998 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260618 19:57:30.812141 4998 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 19:57:30.812218 4998 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260618 19:57:30.823359 4998 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.158.148:40109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:43379
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.158.188:34975
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.2.158.188
--webserver_port=36245
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 18 Jun 2026 19:43:24 UTC on bdcb31816ec0
build id 12458
ASAN enabled
I20260618 19:57:30.825083 4998 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 19:57:30.827369 4998 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260618 19:57:30.836341 5014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 19:57:30.836421 5012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 19:57:30.836378 5011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 19:57:30.838990 4998 server_base.cc:1061] running on GCE node
I20260618 19:57:30.839955 4998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 19:57:30.842466 4998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 19:57:30.843739 4998 hybrid_clock.cc:648] HybridClock initialized: now 1781812650843642 us; error 51 us; skew 500 ppm
I20260618 19:57:30.844122 4998 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260618 19:57:30.846664 4998 webserver.cc:533] Webserver started at http://127.2.158.188:36245/ using document root <none> and password file <none>
I20260618 19:57:30.847476 4998 fs_manager.cc:362] Metadata directory not provided
I20260618 19:57:30.847571 4998 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 19:57:30.853826 4998 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260618 19:57:30.857554 5020 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 19:57:30.859201 4998 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260618 19:57:30.859428 4998 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data,/tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/wal
uuid: "6c13c838eb85465090e1bff0df28912f"
format_stamp: "Formatted at 2026-06-18 19:57:00 on dist-test-slave-6zlr"
I20260618 19:57:30.860251 4998 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 19:57:30.876677 4998 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 19:57:30.878268 4998 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 19:57:30.878621 4998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 19:57:30.902943 4998 rpc_server.cc:307] RPC server started. Bound to: 127.2.158.188:34975
I20260618 19:57:30.902943 5071 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.158.188:34975 every 8 connection(s)
I20260618 19:57:30.904742 4998 server_base.cc:1193] Dumped server information to /tmp/dist-test-task_3iVrE/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781812601565614-2682-0/minicluster-data/master-2/data/info.pb
I20260618 19:57:30.908390 2682 external_mini_cluster.cc:1434] Started /tmp/dist-test-task_3iVrE/build/asan/bin/kudu as pid 4998
I20260618 19:57:30.913923 5072 sys_catalog.cc:263] Verifying existing consensus state
I20260618 19:57:30.918210 5072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: Bootstrap starting.
I20260618 19:57:30.938632 3374 heartbeater.cc:344] Connected to a master server at 127.2.158.188:34975
I20260618 19:57:30.944597 5072 log.cc:826] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: Log is configured to *not* fsync() on all Append() calls
I20260618 19:57:30.988230 5072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: Bootstrap replayed 1/1 log segments. Stats: ops{read=60 overwritten=1 applied=59 ignored=0} inserts{seen=38 ignored=0} mutations{seen=45 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260618 19:57:30.988797 5072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: Bootstrap complete.
I20260618 19:57:30.995018 5072 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:30.996119 5072 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c13c838eb85465090e1bff0df28912f, State: Initialized, Role: FOLLOWER
I20260618 19:57:30.996906 5072 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 59, Last appended: 8.59, Last appended by leader: 59, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:30.997913 5079 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } } }
I20260618 19:57:30.998391 5079 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: This master's current role is: FOLLOWER
I20260618 19:57:30.999354 5072 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [sys.catalog]: configured and running, proceeding with master startup.
I20260618 19:57:31.000741 3657 heartbeater.cc:344] Connected to a master server at 127.2.158.188:34975
I20260618 19:57:31.013731 5094 catalog_manager.cc:1294] Loaded cluster ID: 2cd457c38b944bab8903c2f58018327f
I20260618 19:57:31.013938 5094 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: loading cluster ID for follower catalog manager: success
I20260618 19:57:31.009639 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:57:31.019309 5094 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: acquiring CA information for follower catalog manager: success
I20260618 19:57:31.019529 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260618 19:57:31.022580 5094 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260618 19:57:31.209030 3513 heartbeater.cc:344] Connected to a master server at 127.2.158.188:34975
I20260618 19:57:31.211675 5037 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" instance_seqno: 1781812621902304) as {username='slave'} at 127.2.158.130:42513; Asking this server to re-register.
I20260618 19:57:31.212379 3513 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:31.215044 5037 ts_manager.cc:194] Registered new tserver with Master: 722df47a60ca4bfa82104dea57718f3b (127.2.158.130:34483)
I20260618 19:57:31.407634 3466 raft_consensus.cc:1275] T bce5543840af43b7b9933eb585ceeb80 P 722df47a60ca4bfa82104dea57718f3b [term 2 FOLLOWER]: Refusing update from remote peer 51c7777f264b496a9bf9511966dcfbd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260618 19:57:31.408392 5098 consensus_queue.cc:1048] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "722df47a60ca4bfa82104dea57718f3b" member_type: VOTER last_known_addr { host: "127.2.158.130" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260618 19:57:31.416888 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 1: this message will repeat every 5th retry.
I20260618 19:57:31.419637 5037 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" instance_seqno: 1781812621349212) as {username='slave'} at 127.2.158.129:58833; Asking this server to re-register.
I20260618 19:57:31.420295 3374 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:31.422005 5037 ts_manager.cc:194] Registered new tserver with Master: 51c7777f264b496a9bf9511966dcfbd7 (127.2.158.129:44205)
I20260618 19:57:31.504725 5037 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6bb3ca8239f4412fb8b0e7d0df9e50c1" instance_seqno: 1781812622463911) as {username='slave'} at 127.2.158.131:56479; Asking this server to re-register.
I20260618 19:57:31.505708 3657 heartbeater.cc:461] Registering TS with master...
I20260618 19:57:31.507258 5037 ts_manager.cc:194] Registered new tserver with Master: 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071)
I20260618 19:57:31.592787 5107 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:31.593142 5107 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:31.598625 5107 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:57:31.599094 5021 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:57:31.601111 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:57:31.601476 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 19:57:31.601758 5023 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:31.602205 5107 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260618 19:57:31.883193 3327 raft_consensus.cc:1275] T 83164978e2724f98ac65581b775089b9 P 51c7777f264b496a9bf9511966dcfbd7 [term 2 FOLLOWER]: Refusing update from remote peer 722df47a60ca4bfa82104dea57718f3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260618 19:57:31.883836 5113 consensus_queue.cc:1048] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "51c7777f264b496a9bf9511966dcfbd7" member_type: VOTER last_known_addr { host: "127.2.158.129" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260618 19:57:31.890134 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 1: this message will repeat every 5th retry.
I20260618 19:57:32.292631 5118 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:32.292992 5118 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:32.294571 5118 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:57:32.297632 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:57:32.297878 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 19:57:32.298045 5023 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:32.298485 5118 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260618 19:57:33.164963 5130 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:33.165249 5130 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:33.166114 5130 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:57:33.169135 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
W20260618 19:57:33.169674 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 19:57:33.169818 5021 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:33.170120 5130 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260618 19:57:33.311100 2682 master-stress-test.cc:579] Killing test thread 1/25
I20260618 19:57:34.774096 5151 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:34.774423 5151 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:34.775142 5151 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:57:34.777503 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
W20260618 19:57:34.777899 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 19:57:34.778065 5021 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:34.778366 5151 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260618 19:57:35.817375 5166 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:35.817615 5166 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:35.818364 5166 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:57:35.820952 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:57:35.821125 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 19:57:35.821269 5023 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:35.821576 5166 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260618 19:57:36.024663 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:57:36.024951 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260618 19:57:37.193696 5187 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:37.193926 5187 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:37.195000 5187 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:57:37.196216 5021 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20260618 19:57:37.197754 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:57:37.198086 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 19:57:37.198194 5023 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:37.198434 5187 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260618 19:57:39.107882 5212 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:39.108197 5212 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:39.109184 5212 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:57:39.112164 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:57:39.112511 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 19:57:39.112624 5023 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:39.112931 5212 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260618 19:57:39.564083 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 6: this message will repeat every 5th retry.
I20260618 19:57:41.026806 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:57:41.027031 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 19:57:41.712652 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 6: this message will repeat every 5th retry.
W20260618 19:57:41.963279 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 6: this message will repeat every 5th retry.
I20260618 19:57:45.873365 5289 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:45.873597 5289 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:45.874260 5289 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:57:45.875406 5021 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260618 19:57:45.876652 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
W20260618 19:57:45.876924 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 19:57:45.877028 5021 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:45.877312 5289 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260618 19:57:46.028309 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:57:46.028554 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 19:57:49.914851 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 11: this message will repeat every 5th retry.
I20260618 19:57:51.031258 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:57:51.031523 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 19:57:51.476377 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 11: this message will repeat every 5th retry.
W20260618 19:57:52.219038 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 11: this message will repeat every 5th retry.
I20260618 19:57:53.063423 5382 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:57:53.063673 5382 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:57:53.064462 5382 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:57:53.065564 5023 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260618 19:57:53.067216 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:57:53.067530 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 19:57:53.067709 5023 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:57:53.068043 5382 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260618 19:57:56.033195 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:57:56.033403 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 19:57:59.847460 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 16: this message will repeat every 5th retry.
I20260618 19:58:01.035132 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:58:01.035334 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 19:58:01.137145 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 16: this message will repeat every 5th retry.
W20260618 19:58:02.390115 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 16: this message will repeat every 5th retry.
W20260618 19:58:03.066308 3656 heartbeater.cc:646] Failed to heartbeat to 127.2.158.190:41233 (94 consecutive failures): Network error: Failed to ping master at 127.2.158.190:41233: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:58:03.224954 3512 heartbeater.cc:646] Failed to heartbeat to 127.2.158.190:41233 (133 consecutive failures): Network error: Failed to ping master at 127.2.158.190:41233: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:58:03.315138 3373 heartbeater.cc:646] Failed to heartbeat to 127.2.158.190:41233 (112 consecutive failures): Network error: Failed to ping master at 127.2.158.190:41233: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 19:58:06.037441 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:58:06.037670 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260618 19:58:08.710764 5570 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:58:08.710987 5570 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:58:08.712193 5570 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:58:08.714152 5023 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260618 19:58:08.716583 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:58:08.717111 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 19:58:08.717312 5023 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:58:08.717602 5570 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260618 19:58:09.729797 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 21: this message will repeat every 5th retry.
I20260618 19:58:11.039537 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:58:11.039834 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 19:58:11.310333 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 21: this message will repeat every 5th retry.
W20260618 19:58:11.695482 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 21: this message will repeat every 5th retry.
I20260618 19:58:16.041966 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:58:16.042269 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 19:58:20.522360 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 26: this message will repeat every 5th retry.
I20260618 19:58:21.044024 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:58:21.044286 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 19:58:21.717727 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 26: this message will repeat every 5th retry.
W20260618 19:58:21.939734 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 26: this message will repeat every 5th retry.
I20260618 19:58:26.046175 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:58:26.046368 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260618 19:58:27.615988 5790 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:58:27.616223 5790 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:58:27.617148 5790 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:58:27.618201 5023 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260618 19:58:27.619575 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
W20260618 19:58:27.619741 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 19:58:27.619868 5021 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:58:27.620332 5790 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260618 19:58:30.980096 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 31: this message will repeat every 5th retry.
I20260618 19:58:31.048475 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:58:31.048700 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 19:58:31.058763 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 31: this message will repeat every 5th retry.
W20260618 19:58:31.772956 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 31: this message will repeat every 5th retry.
I20260618 19:58:36.050513 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:58:36.050779 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260618 19:58:41.052690 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:58:41.052945 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 19:58:41.275756 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 36: this message will repeat every 5th retry.
W20260618 19:58:41.585044 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 36: this message will repeat every 5th retry.
W20260618 19:58:41.859934 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 36: this message will repeat every 5th retry.
I20260618 19:58:45.495728 6006 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:58:45.496009 6006 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:58:45.498237 6006 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:58:45.498582 5021 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260618 19:58:45.500645 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:58:45.500826 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 19:58:45.501010 5023 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:58:45.501308 6006 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260618 19:58:46.055121 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:58:46.055353 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260618 19:58:51.057353 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:58:51.057595 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 19:58:51.065027 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 41: this message will repeat every 5th retry.
I20260618 19:58:51.143252 6072 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:58:51.143553 6072 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:58:51.144479 6072 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:58:51.145151 5023 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260618 19:58:51.146451 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
W20260618 19:58:51.146618 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 19:58:51.146740 5021 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:58:51.146994 6072 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260618 19:58:51.507668 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 41: this message will repeat every 5th retry.
W20260618 19:58:51.775581 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 41: this message will repeat every 5th retry.
I20260618 19:58:56.059185 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:58:56.059404 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260618 19:59:01.061328 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:59:01.061561 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 19:59:01.299523 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 46: this message will repeat every 5th retry.
W20260618 19:59:01.334403 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 46: this message will repeat every 5th retry.
W20260618 19:59:01.558099 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 46: this message will repeat every 5th retry.
W20260618 19:59:03.234484 3656 heartbeater.cc:646] Failed to heartbeat to 127.2.158.190:41233 (214 consecutive failures): Network error: Failed to ping master at 127.2.158.190:41233: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:59:03.540645 3373 heartbeater.cc:646] Failed to heartbeat to 127.2.158.190:41233 (259 consecutive failures): Network error: Failed to ping master at 127.2.158.190:41233: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:59:03.578312 3514 heartbeater.cc:646] Failed to heartbeat to 127.2.158.189:45955 (292 consecutive failures): Network error: Failed to ping master at 127.2.158.189:45955: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 19:59:06.063225 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:59:06.063442 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260618 19:59:08.684237 6267 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:59:08.684440 6267 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:59:08.685487 6267 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:59:08.687112 5021 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260618 19:59:08.688263 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
W20260618 19:59:08.688422 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 19:59:08.688555 5021 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:59:08.688889 6267 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260618 19:59:10.973038 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 51: this message will repeat every 5th retry.
I20260618 19:59:11.065340 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:59:11.065557 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 19:59:11.408373 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 51: this message will repeat every 5th retry.
W20260618 19:59:11.833781 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 51: this message will repeat every 5th retry.
I20260618 19:59:16.067584 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:59:16.067852 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260618 19:59:21.069577 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:59:21.069765 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 19:59:21.122128 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 56: this message will repeat every 5th retry.
W20260618 19:59:21.473703 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 56: this message will repeat every 5th retry.
W20260618 19:59:21.478492 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 56: this message will repeat every 5th retry.
I20260618 19:59:26.072199 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:59:26.072453 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260618 19:59:27.513362 6488 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:59:27.513599 6488 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:59:27.514571 6488 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:59:27.515739 5021 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260618 19:59:27.517234 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
W20260618 19:59:27.517460 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 19:59:27.517558 5021 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:59:27.517786 6488 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260618 19:59:30.792395 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 61: this message will repeat every 5th retry.
W20260618 19:59:31.073338 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 61: this message will repeat every 5th retry.
I20260618 19:59:31.074208 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:59:31.074389 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260618 19:59:31.083169 5026 maintenance_manager.cc:419] P 6c13c838eb85465090e1bff0df28912f: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033357
I20260618 19:59:31.136415 5025 maintenance_manager.cc:643] P 6c13c838eb85465090e1bff0df28912f: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.052s user 0.029s sys 0.000s Metrics: {"bytes_written":16166,"cfile_init":1,"dirs.queue_time_us":443,"dirs.run_cpu_time_us":231,"dirs.run_wall_time_us":1009,"drs_written":1,"lbm_read_time_us":74,"lbm_reads_lt_1ms":4,"lbm_write_time_us":810,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":38,"thread_start_us":560,"threads_started":2,"wal-append.queue_time_us":396}
I20260618 19:59:31.137728 5026 maintenance_manager.cc:419] P 6c13c838eb85465090e1bff0df28912f: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 2020 bytes on disk
I20260618 19:59:31.138463 5025 maintenance_manager.cc:643] P 6c13c838eb85465090e1bff0df28912f: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":75,"lbm_reads_lt_1ms":4}
W20260618 19:59:32.093750 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 61: this message will repeat every 5th retry.
I20260618 19:59:36.076472 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:59:36.076771 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260618 19:59:41.078539 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:59:41.078809 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 19:59:41.157166 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 66: this message will repeat every 5th retry.
W20260618 19:59:42.461470 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 66: this message will repeat every 5th retry.
W20260618 19:59:42.572654 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 66: this message will repeat every 5th retry.
I20260618 19:59:42.649091 6703 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:59:42.649359 6703 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:59:42.650230 6703 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:59:42.651185 5023 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260618 19:59:42.653090 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
W20260618 19:59:42.653417 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 19:59:42.653528 5021 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:59:42.653823 6703 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260618 19:59:43.707718 6722 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:59:43.707937 6722 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:59:43.708648 6722 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:59:43.711050 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:59:43.711285 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 19:59:43.711472 5023 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:59:43.711810 6722 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260618 19:59:46.080336 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:59:46.080564 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260618 19:59:51.082726 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:59:51.082976 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 19:59:51.703902 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 71: this message will repeat every 5th retry.
W20260618 19:59:51.935739 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 71: this message will repeat every 5th retry.
W20260618 19:59:52.706826 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 71: this message will repeat every 5th retry.
I20260618 19:59:56.085183 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 19:59:56.085534 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260618 19:59:57.530884 6932 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 19:59:57.531116 6932 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 19:59:57.532074 6932 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 19:59:57.533212 5021 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260618 19:59:57.534809 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 19:59:57.534979 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 19:59:57.535141 5023 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 19:59:57.535409 6932 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260618 20:00:01.087236 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:00:01.087510 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 20:00:01.135668 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 76: this message will repeat every 5th retry.
W20260618 20:00:01.821439 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 76: this message will repeat every 5th retry.
W20260618 20:00:02.479480 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 76: this message will repeat every 5th retry.
W20260618 20:00:03.410166 3656 heartbeater.cc:646] Failed to heartbeat to 127.2.158.190:41233 (334 consecutive failures): Network error: Failed to ping master at 127.2.158.190:41233: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 20:00:03.703358 3373 heartbeater.cc:646] Failed to heartbeat to 127.2.158.190:41233 (408 consecutive failures): Network error: Failed to ping master at 127.2.158.190:41233: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 20:00:03.904798 3514 heartbeater.cc:646] Failed to heartbeat to 127.2.158.189:45955 (472 consecutive failures): Network error: Failed to ping master at 127.2.158.189:45955: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 20:00:06.089705 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:00:06.089958 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 20:00:10.790973 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 81: this message will repeat every 5th retry.
I20260618 20:00:11.092541 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:00:11.092882 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 20:00:11.818238 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 81: this message will repeat every 5th retry.
W20260618 20:00:13.048230 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 81: this message will repeat every 5th retry.
I20260618 20:00:15.483122 7209 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 20:00:15.483378 7209 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 20:00:15.484472 7209 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 20:00:15.485594 5021 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260618 20:00:15.487090 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 20:00:15.487372 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 20:00:15.487557 5023 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 20:00:15.487854 7209 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260618 20:00:16.094864 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:00:16.095144 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 20:00:19.520718 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 86: this message will repeat every 5th retry.
I20260618 20:00:21.097385 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:00:21.098037 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 20:00:22.123961 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 86: this message will repeat every 5th retry.
W20260618 20:00:22.826100 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 86: this message will repeat every 5th retry.
I20260618 20:00:26.099964 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:00:26.100301 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 20:00:29.472128 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 91: this message will repeat every 5th retry.
I20260618 20:00:31.102161 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:00:31.102449 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 20:00:32.040328 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 91: this message will repeat every 5th retry.
W20260618 20:00:32.228212 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 91: this message will repeat every 5th retry.
I20260618 20:00:34.554385 7498 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 20:00:34.554733 7498 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 20:00:34.555809 7498 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 20:00:34.557766 5021 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260618 20:00:34.560155 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
W20260618 20:00:34.560511 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 20:00:34.560678 5021 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 20:00:34.561690 7498 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260618 20:00:36.104738 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:00:36.105023 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 20:00:39.077201 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 96: this message will repeat every 5th retry.
I20260618 20:00:40.947635 7600 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 20:00:40.947868 7600 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 20:00:40.948652 7600 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 20:00:40.949944 5023 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260618 20:00:40.951393 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
W20260618 20:00:40.951632 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 20:00:40.951763 5021 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 20:00:40.952086 7600 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260618 20:00:41.106526 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:00:41.106839 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 20:00:41.709848 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 96: this message will repeat every 5th retry.
W20260618 20:00:42.452521 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 96: this message will repeat every 5th retry.
I20260618 20:00:46.108477 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:00:46.108681 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 20:00:48.679633 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 101: this message will repeat every 5th retry.
W20260618 20:00:51.065728 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 101: this message will repeat every 5th retry.
I20260618 20:00:51.110285 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:00:51.110513 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 20:00:52.102990 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 101: this message will repeat every 5th retry.
I20260618 20:00:52.956161 7772 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 20:00:52.956406 7772 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 20:00:52.957497 7772 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 20:00:52.959287 5021 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260618 20:00:52.960965 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 20:00:52.961217 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 20:00:52.961381 5023 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 20:00:52.961656 7772 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260618 20:00:56.112262 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:00:56.112506 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 20:00:57.828426 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 106: this message will repeat every 5th retry.
W20260618 20:01:01.031652 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 106: this message will repeat every 5th retry.
I20260618 20:01:01.114840 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:01:01.115116 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 20:01:01.992861 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 106: this message will repeat every 5th retry.
W20260618 20:01:03.601043 3656 heartbeater.cc:646] Failed to heartbeat to 127.2.158.190:41233 (454 consecutive failures): Network error: Failed to ping master at 127.2.158.190:41233: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 20:01:03.796281 3373 heartbeater.cc:646] Failed to heartbeat to 127.2.158.190:41233 (556 consecutive failures): Network error: Failed to ping master at 127.2.158.190:41233: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 20:01:03.991251 3514 heartbeater.cc:646] Failed to heartbeat to 127.2.158.189:45955 (661 consecutive failures): Network error: Failed to ping master at 127.2.158.189:45955: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 20:01:06.117038 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:01:06.117496 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260618 20:01:06.243229 7978 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 20:01:06.243484 7978 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 20:01:06.244315 7978 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 20:01:06.245090 5023 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260618 20:01:06.246515 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
W20260618 20:01:06.246817 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 20:01:06.246934 5021 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 20:01:06.247241 7978 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260618 20:01:07.606485 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 111: this message will repeat every 5th retry.
I20260618 20:01:11.120218 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:01:11.120415 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 20:01:11.816697 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 111: this message will repeat every 5th retry.
W20260618 20:01:12.271399 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 111: this message will repeat every 5th retry.
I20260618 20:01:16.121920 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:01:16.122175 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 20:01:18.455655 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 116: this message will repeat every 5th retry.
I20260618 20:01:21.026188 8220 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 20:01:21.026461 8220 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 20:01:21.027292 8220 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 20:01:21.028499 5023 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260618 20:01:21.030129 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
W20260618 20:01:21.030354 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 20:01:21.030469 5021 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 20:01:21.030874 8220 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260618 20:01:21.124044 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:01:21.124336 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 20:01:21.787798 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 116: this message will repeat every 5th retry.
W20260618 20:01:22.803473 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 116: this message will repeat every 5th retry.
I20260618 20:01:24.836241 8288 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 20:01:24.836442 8288 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 20:01:24.837237 8288 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 20:01:24.840001 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 20:01:24.840415 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 20:01:24.840600 5023 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 20:01:24.840919 8288 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260618 20:01:25.830868 8314 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 20:01:25.831104 8314 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 20:01:25.831871 8314 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 20:01:25.834427 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 20:01:25.834592 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 20:01:25.834734 5023 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 20:01:25.835032 8314 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260618 20:01:26.125917 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:01:26.126195 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 20:01:28.082280 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 121: this message will repeat every 5th retry.
I20260618 20:01:31.127784 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:01:31.128028 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 20:01:31.585439 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 121: this message will repeat every 5th retry.
W20260618 20:01:32.206202 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 121: this message will repeat every 5th retry.
I20260618 20:01:36.130129 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:01:36.130342 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 20:01:37.799834 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 126: this message will repeat every 5th retry.
I20260618 20:01:40.301185 8555 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 20:01:40.301515 8555 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 20:01:40.302318 8555 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 20:01:40.303982 5023 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20260618 20:01:40.305735 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
W20260618 20:01:40.306233 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 20:01:40.306375 5021 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 20:01:40.306679 8555 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260618 20:01:41.132531 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:01:41.132803 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 20:01:41.567488 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 126: this message will repeat every 5th retry.
W20260618 20:01:42.011209 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 126: this message will repeat every 5th retry.
I20260618 20:01:44.944747 8650 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 20:01:44.944983 8650 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 20:01:44.945817 8650 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 20:01:44.948374 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 20:01:44.948693 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 20:01:44.948849 5023 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 20:01:44.949115 8650 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260618 20:01:46.134910 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:01:46.135130 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 20:01:48.420992 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 131: this message will repeat every 5th retry.
I20260618 20:01:48.523149 8720 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 20:01:48.523427 8720 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 20:01:48.524257 8720 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 20:01:48.525506 5021 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260618 20:01:48.526821 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 20:01:48.527083 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 20:01:48.527204 5023 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 20:01:48.527446 8720 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260618 20:01:51.137038 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:01:51.137363 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 20:01:51.813495 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 131: this message will repeat every 5th retry.
W20260618 20:01:51.951601 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 131: this message will repeat every 5th retry.
I20260618 20:01:56.139832 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:01:56.140049 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260618 20:01:56.232438 8857 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 20:01:56.232636 8857 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 20:01:56.233368 8857 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 20:01:56.234100 5021 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260618 20:01:56.235452 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 20:01:56.235759 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 20:01:56.235908 5023 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 20:01:56.236223 8857 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260618 20:01:59.091854 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 136: this message will repeat every 5th retry.
I20260618 20:02:01.142277 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:02:01.142484 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 20:02:01.583653 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 136: this message will repeat every 5th retry.
W20260618 20:02:02.502004 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 136: this message will repeat every 5th retry.
I20260618 20:02:03.370404 8998 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 20:02:03.370888 8998 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 20:02:03.371903 8998 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 20:02:03.373163 5023 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260618 20:02:03.374563 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
W20260618 20:02:03.374756 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 20:02:03.374964 5021 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 20:02:03.375313 8998 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260618 20:02:03.828083 3656 heartbeater.cc:646] Failed to heartbeat to 127.2.158.190:41233 (574 consecutive failures): Network error: Failed to ping master at 127.2.158.190:41233: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 20:02:04.025911 3373 heartbeater.cc:646] Failed to heartbeat to 127.2.158.190:41233 (706 consecutive failures): Network error: Failed to ping master at 127.2.158.190:41233: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 20:02:04.057853 3514 heartbeater.cc:646] Failed to heartbeat to 127.2.158.189:45955 (843 consecutive failures): Network error: Failed to ping master at 127.2.158.189:45955: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 20:02:06.144227 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:02:06.144447 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 20:02:07.915239 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 141: this message will repeat every 5th retry.
I20260618 20:02:08.905337 9101 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 20:02:08.905606 9101 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 20:02:08.906531 9101 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 20:02:08.908555 5023 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260618 20:02:08.910161 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
W20260618 20:02:08.910493 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
I20260618 20:02:08.910629 5021 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 20:02:08.910993 9101 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260618 20:02:11.037197 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 141: this message will repeat every 5th retry.
I20260618 20:02:11.146356 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:02:11.146667 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 20:02:12.842963 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 141: this message will repeat every 5th retry.
I20260618 20:02:16.148804 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:02:16.149031 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 20:02:17.635267 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 146: this message will repeat every 5th retry.
I20260618 20:02:21.150811 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:02:21.151041 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 20:02:21.457840 3264 consensus_peers.cc:597] T bce5543840af43b7b9933eb585ceeb80 P 51c7777f264b496a9bf9511966dcfbd7 -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bce5543840af43b7b9933eb585ceeb80. This is attempt 146: this message will repeat every 5th retry.
W20260618 20:02:22.029781 3403 consensus_peers.cc:597] T 83164978e2724f98ac65581b775089b9 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83164978e2724f98ac65581b775089b9. This is attempt 146: this message will repeat every 5th retry.
I20260618 20:02:25.539089 9417 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 20:02:25.539331 9417 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc600e5aa44409ea3ce4c2861cb4de1" member_type: VOTER last_known_addr { host: "127.2.158.190" port: 41233 } } peers { permanent_uuid: "0447960184714aaf886ca15b9aa0e63a" member_type: VOTER last_known_addr { host: "127.2.158.189" port: 45955 } } peers { permanent_uuid: "6c13c838eb85465090e1bff0df28912f" member_type: VOTER last_known_addr { host: "127.2.158.188" port: 34975 } }
I20260618 20:02:25.540345 9417 leader_election.cc:290] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233), 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955)
W20260618 20:02:25.541515 5021 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260618 20:02:25.543429 5021 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer acc600e5aa44409ea3ce4c2861cb4de1 (127.2.158.190:41233): Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111)
W20260618 20:02:25.543985 5023 leader_election.cc:336] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0447960184714aaf886ca15b9aa0e63a (127.2.158.189:45955): Network error: Client connection negotiation failed: client connection to 127.2.158.189:45955: connect: Connection refused (error 111)
I20260618 20:02:25.544178 5023 leader_election.cc:304] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c13c838eb85465090e1bff0df28912f; no voters: 0447960184714aaf886ca15b9aa0e63a, acc600e5aa44409ea3ce4c2861cb4de1
I20260618 20:02:25.544515 9417 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6c13c838eb85465090e1bff0df28912f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260618 20:02:26.152978 4998 master_runner.cc:187] Error getting master registration for 127.2.158.190:41233: Network error: Client connection negotiation failed: client connection to 127.2.158.190:41233: connect: Connection refused (error 111),
I20260618 20:02:26.153213 4998 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260618 20:02:26.730448 3403 consensus_peers.cc:597] T 182415f6a2c94b9fa32ae241aced8853 P 722df47a60ca4bfa82104dea57718f3b -> Peer 6bb3ca8239f4412fb8b0e7d0df9e50c1 (127.2.158.131:33071): Couldn't send request to peer 6bb3ca8239f4412fb8b0e7d0df9e50c1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182415f6a2c94b9fa32ae241aced8853. This is attempt 151: this message will repeat every 5th retry.
I20260618 20:02:27.707391 5026 maintenance_manager.cc:419] P 6c13c838eb85465090e1bff0df28912f: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 2020 bytes on disk
I20260618 20:02:27.712252 5025 maintenance_manager.cc:643] P 6c13c838eb85465090e1bff0df28912f: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.004s user 0.004s sys 0.000s Metrics: {"dirs.queue_time_us":368,"dirs.run_cpu_time_us":95,"dirs.run_wall_time_us":96,"thread_start_us":547,"threads_started":2,"wal-append.queue_time_us":337}
W20260618 20:02:27.993806 3668 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)
W20260618 20:02:27.994165 3668 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)
W20260618 20:02:27.994302 3668 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)
W20260618 20:02:27.994429 3668 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)
F20260618 20:02:28.005996 3700 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)
*** Check failure stack trace: ***
F20260618 20:02:28.005996 3700 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006301 3674 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_62590bf88ede4e85b45e9a0cc4185c2c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)
*** Check failure stack trace: ***
*** Aborted at 1781812948 (unix time) try "date -d @1781812948" if you are using GNU date ***
F20260618 20:02:28.005996 3700 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006301 3674 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_62590bf88ede4e85b45e9a0cc4185c2c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006436 3694 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)
*** Check failure stack trace: ***
F20260618 20:02:28.005888 3680 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_131e341c9bb840f7860a9fcaf6a2ec23 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)
*** Check failure stack trace: ***
F20260618 20:02:28.005996 3700 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006301 3674 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_62590bf88ede4e85b45e9a0cc4185c2c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006436 3694 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006928 3675 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ddc5d076daac47b4bd3e0dacbde21f5f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007100 3685 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)
*** Check failure stack trace: ***
F20260618 20:02:28.005996 3700 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006301 3674 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_62590bf88ede4e85b45e9a0cc4185c2c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006436 3694 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006928 3675 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ddc5d076daac47b4bd3e0dacbde21f5f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007100 3685 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)
*** Check failure stack trace: ***
F20260618 20:02:28.005996 3700 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006301 3674 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_62590bf88ede4e85b45e9a0cc4185c2c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006436 3694 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006928 3675 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ddc5d076daac47b4bd3e0dacbde21f5f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007100 3685 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007678 3699 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)
*** Check failure stack trace: ***
F20260618 20:02:28.005996 3700 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006301 3674 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_62590bf88ede4e85b45e9a0cc4185c2c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006436 3694 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006928 3675 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ddc5d076daac47b4bd3e0dacbde21f5f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007100 3685 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007678 3699 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007757 3684 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)
*** Check failure stack trace: ***
F20260618 20:02:28.005996 3700 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006301 3674 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_62590bf88ede4e85b45e9a0cc4185c2c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006436 3694 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006928 3675 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ddc5d076daac47b4bd3e0dacbde21f5f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007100 3685 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007678 3699 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007757 3684 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008754 3679 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3354ed02c5b4402089d56d478de4d48b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)
*** Check failure stack trace: ***
F20260618 20:02:28.005996 3700 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006301 3674 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_62590bf88ede4e85b45e9a0cc4185c2c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006436 3694 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006928 3675 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ddc5d076daac47b4bd3e0dacbde21f5f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007100 3685 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007678 3699 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007757 3684 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008754 3679 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3354ed02c5b4402089d56d478de4d48b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008883 3692 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)
*** Check failure stack trace: ***
F20260618 20:02:28.005996 3700 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006301 3674 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_62590bf88ede4e85b45e9a0cc4185c2c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006436 3694 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006928 3675 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ddc5d076daac47b4bd3e0dacbde21f5f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007100 3685 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007678 3699 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007757 3684 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008754 3679 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3354ed02c5b4402089d56d478de4d48b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008883 3692 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008880 3691 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)
*** Check failure stack trace: ***
F20260618 20:02:28.005996 3700 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006301 3674 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_62590bf88ede4e85b45e9a0cc4185c2c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006436 3694 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006928 3675 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ddc5d076daac47b4bd3e0dacbde21f5f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007100 3685 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007678 3699 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007757 3684 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008754 3679 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3354ed02c5b4402089d56d478de4d48b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008883 3692 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008880 3691 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009321 3698 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)
*** Check failure stack trace: ***
F20260618 20:02:28.005996 3700 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006301 3674 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_62590bf88ede4e85b45e9a0cc4185c2c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006436 3694 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006928 3675 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ddc5d076daac47b4bd3e0dacbde21f5f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007100 3685 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007678 3699 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007757 3684 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008754 3679 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3354ed02c5b4402089d56d478de4d48b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008883 3692 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008880 3691 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009321 3698 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009358 3688 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)
*** Check failure stack trace: ***
F20260618 20:02:28.005996 3700 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006301 3674 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_62590bf88ede4e85b45e9a0cc4185c2c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006436 3694 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006928 3675 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ddc5d076daac47b4bd3e0dacbde21f5f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007100 3685 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007678 3699 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007757 3684 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008754 3679 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3354ed02c5b4402089d56d478de4d48b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008883 3692 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008880 3691 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009321 3698 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009358 3688 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009727 3683 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0711d10accfd429788e8e459cacc6139 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009747 3682 master-stress-test.cc:299] Check failed: _s.ok() B*** Check failure stack trace: ***
F20260618 20:02:28.005996 3700 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006301 3674 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_62590bf88ede4e85b45e9a0cc4185c2c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006436 3694 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006928 3675 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ddc5d076daac47b4bd3e0dacbde21f5f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007100 3685 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007678 3699 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007757 3684 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008754 3679 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3354ed02c5b4402089d56d478de4d48b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008883 3692 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008880 3691 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009321 3698 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009358 3688 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009727 3683 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0711d10accfd429788e8e459cacc6139 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009747 3682 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fa143415606c44cf80647e88be53822a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)
*** Check failure stack trace: ***
F20260618 20:02:28.005996 3700 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006301 3674 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_62590bf88ede4e85b45e9a0cc4185c2c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006436 3694 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006928 3675 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ddc5d076daac47b4bd3e0dacbde21f5f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007100 3685 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007678 3699 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007757 3684 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008754 3679 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3354ed02c5b4402089d56d478de4d48b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008883 3692 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008880 3691 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009321 3698 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009358 3688 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009727 3683 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0711d10accfd429788e8e459cacc6139 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009747 3682 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fa143415606c44cf80647e88be53822a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011358 3687 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011323 *** Check failure stack trace: ***
F20260618 20:02:28.005996 3700 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006301 3674 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_62590bf88ede4e85b45e9a0cc4185c2c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006436 3694 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006928 3675 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ddc5d076daac47b4bd3e0dacbde21f5f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007100 3685 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007678 3699 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007757 3684 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008754 3679 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3354ed02c5b4402089d56d478de4d48b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008883 3692 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008880 3691 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009321 3698 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009358 3688 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009727 3683 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0711d10accfd429788e8e459cacc6139 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009747 3682 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fa143415606c44cf80647e88be53822a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011358 3687 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011323 3677 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_917e434e2f0140148e432b0324ad9763 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011343 3678 master-stress-test.cc:330] Check failed: _s.ok() Bad status: T*** Check failure stack trace: ***
F20260618 20:02:28.005996 3700 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006301 3674 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_62590bf88ede4e85b45e9a0cc4185c2c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006436 3694 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006928 3675 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ddc5d076daac47b4bd3e0dacbde21f5f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007100 3685 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007678 3699 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007757 3684 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008754 3679 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3354ed02c5b4402089d56d478de4d48b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008883 3692 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008880 3691 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009321 3698 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009358 3688 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009727 3683 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0711d10accfd429788e8e459cacc6139 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009747 3682 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fa143415606c44cf80647e88be53822a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011358 3687 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011323 3677 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_917e434e2f0140148e432b0324ad9763 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011343 3678 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b536ea4ed5c945adb98d4d2c41448d70 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)
*** Check failure stack trace: ***
F20260618 20:02:28.005996 3700 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006301 3674 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_62590bf88ede4e85b45e9a0cc4185c2c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006436 3694 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006928 3675 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ddc5d076daac47b4bd3e0dacbde21f5f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007100 3685 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007678 3699 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007757 3684 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008754 3679 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3354ed02c5b4402089d56d478de4d48b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008883 3692 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008880 3691 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009321 3698 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009358 3688 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009727 3683 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0711d10accfd429788e8e459cacc6139 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009747 3682 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fa143415606c44cf80647e88be53822a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011358 3687 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011323 3677 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_917e434e2f0140148e432b0324ad9763 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011343 3678 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b536ea4ed5c945adb98d4d2c41448d70 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011904 3690 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)
*** Check failure stack trace: ***
F20260618 20:02:28.005996 3700 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006301 3674 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_62590bf88ede4e85b45e9a0cc4185c2c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006436 3694 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006928 3675 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ddc5d076daac47b4bd3e0dacbde21f5f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007100 3685 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007678 3699 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007757 3684 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008754 3679 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3354ed02c5b4402089d56d478de4d48b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008883 3692 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008880 3691 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009321 3698 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009358 3688 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009727 3683 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0711d10accfd429788e8e459cacc6139 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009747 3682 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fa143415606c44cf80647e88be53822a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011358 3687 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011323 3677 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_917e434e2f0140148e432b0324ad9763 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011343 3678 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b536ea4ed5c945adb98d4d2c41448d70 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011904 3690 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011965 3676 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0975ad87638142ddbb8e4438fc9393a4 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)
*** Check failure stack trace: ***
F20260618 20:02:28.005996 3700 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006301 3674 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_62590bf88ede4e85b45e9a0cc4185c2c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006436 3694 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006928 3675 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ddc5d076daac47b4bd3e0dacbde21f5f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007100 3685 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007678 3699 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007757 3684 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008754 3679 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3354ed02c5b4402089d56d478de4d48b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008883 3692 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008880 3691 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009321 3698 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009358 3688 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009727 3683 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0711d10accfd429788e8e459cacc6139 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009747 3682 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fa143415606c44cf80647e88be53822a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011358 3687 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011323 3677 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_917e434e2f0140148e432b0324ad9763 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011343 3678 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b536ea4ed5c945adb98d4d2c41448d70 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011904 3690 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011965 3676 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0975ad87638142ddbb8e4438fc9393a4 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.012322 3681 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9557e658e4484fffa051fe4e630478d2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)
*** Check failure stack trace: ***
F20260618 20:02:28.005996 3700 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006301 3674 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_62590bf88ede4e85b45e9a0cc4185c2c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006436 3694 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006928 3675 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ddc5d076daac47b4bd3e0dacbde21f5f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007100 3685 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007678 3699 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007757 3684 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008754 3679 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3354ed02c5b4402089d56d478de4d48b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008883 3692 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008880 3691 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009321 3698 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009358 3688 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009727 3683 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0711d10accfd429788e8e459cacc6139 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009747 3682 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fa143415606c44cf80647e88be53822a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011358 3687 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011323 3677 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_917e434e2f0140148e432b0324ad9763 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011343 3678 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b536ea4ed5c945adb98d4d2c41448d70 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011904 3690 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011965 3676 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0975ad87638142ddbb8e4438fc9393a4 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.012322 3681 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9557e658e4484fffa051fe4e630478d2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.012388 3695 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)
*** Check failure stack trace: ***
F20260618 20:02:28.005996 3700 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006301 3674 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_62590bf88ede4e85b45e9a0cc4185c2c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006436 3694 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006928 3675 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ddc5d076daac47b4bd3e0dacbde21f5f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007100 3685 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007678 3699 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007757 3684 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008754 3679 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3354ed02c5b4402089d56d478de4d48b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008883 3692 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008880 3691 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009321 3698 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009358 3688 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009727 3683 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0711d10accfd429788e8e459cacc6139 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009747 3682 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fa143415606c44cf80647e88be53822a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011358 3687 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011323 3677 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_917e434e2f0140148e432b0324ad9763 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011343 3678 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b536ea4ed5c945adb98d4d2c41448d70 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011904 3690 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011965 3676 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0975ad87638142ddbb8e4438fc9393a4 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.012322 3681 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9557e658e4484fffa051fe4e630478d2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.012388 3695 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.013634 3689 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)
*** Check failure stack trace: ***
F20260618 20:02:28.005996 3700 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006301 3674 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_62590bf88ede4e85b45e9a0cc4185c2c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006436 3694 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.006928 3675 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ddc5d076daac47b4bd3e0dacbde21f5f on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007100 3685 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007678 3699 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.007757 3684 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008754 3679 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3354ed02c5b4402089d56d478de4d48b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008883 3692 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.008880 3691 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009321 3698 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009358 3688 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009727 3683 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0711d10accfd429788e8e459cacc6139 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.009747 3682 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fa143415606c44cf80647e88be53822a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011358 3687 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011323 3677 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_917e434e2f0140148e432b0324ad9763 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011343 3678 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b536ea4ed5c945adb98d4d2c41448d70 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011904 3690 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.011965 3676 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0975ad87638142ddbb8e4438fc9393a4 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.012322 3681 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9557e658e4484fffa051fe4e630478d2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.012388 3695 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.013634 3689 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)F20260618 20:02:28.015205 3686 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 770) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.2.158.190:41233,127.2.158.189:45955,127.2.158.188:34975, num_attempts: 1)
*** Check failure stack trace: ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800000a7a) received by PID 2682 (TID 0x7f5682d94700) from PID 2682; stack trace: ***
@ 0x7f56a2276980 (unknown) at ??:0
@ 0x7f569b049e87 gsignal at ??:0
@ 0x7f569b04b7f1 abort at ??:0
@ 0x7f569dd91dcd google::LogMessage::Fail() at ??:0
@ 0x7f569dd95b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f569dd917cc google::LogMessage::Flush() at ??:0
@ 0x7f569dd92f59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x40e275 kudu::MasterStressTest::ReplaceTabletThread() at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/master-stress-test.cc:393
@ 0x44b804 std::__invoke_impl<>() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/invoke.h:73
@ 0x44b6bd std::__invoke<>() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/invoke.h:95
@ 0x44b67a _ZNSt6thread8_InvokerISt5tupleIJMN4kudu16MasterStressTestEFvvEPNS2_26MasterStressTest_Test_TestEEEE9_M_invokeIJLm0ELm1EEEEDTclsr3stdE8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:234
@ 0x44b62e std::thread::_Invoker<>::operator()() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:243
@ 0x44b369 std::thread::_State_impl<>::_M_run() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:186
@ 0x7f569b6d36df (unknown) at ??:0
@ 0x7f56a226b6db start_thread at ??:0
@ 0x7f569b12c61f clone at ??:0