Diagnosed failure

CatalogManagerConfigurations/MasterStressTest.Test/2: Unrecognized error type. Please see the error log for more information.

Full log

Note: This is test shard 3 of 3.
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from CatalogManagerConfigurations/MasterStressTest
[ RUN      ] CatalogManagerConfigurations/MasterStressTest.Test/2
2026-11-20T09:03:04Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-11-20T09:03:04Z Disabled control of system clock
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskH9EWc6/thirdparty/installed/common/opt/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskH9EWc6/thirdparty/installed/common/opt/hadoop/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL:	 jdbc:derby:/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/metadb;create=true
Metastore Connection Driver :	 org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User:	 APP
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.derby.sql

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 

 
 
 
 

 
 
 
 


 
 
 

 
 
 


 
 
 
 
 
 
 


 
 
 

 
 
 

 
 

 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 


 
 
 
 
 
 



 
 
 
 
 


 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 


Initialization script completed
schemaTool completed
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/security.properties
2026-11-20 09:03:11: Starting Hive Metastore Server
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskH9EWc6/thirdparty/installed/common/opt/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskH9EWc6/thirdparty/installed/common/opt/hadoop/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Starting hive metastore on port 0
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20261120 09:03:19.002907 23869 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu
/tmp/dist-test-taskH9EWc6/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.79.126:41659
--webserver_interface=127.23.79.126
--webserver_port=0
--builtin_ntp_servers=127.23.79.84:36147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881
--hive_metastore_uris=thrift://127.0.0.1:38755
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20261120 09:03:19.320257 24150 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261120 09:03:19.320622 24150 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261120 09:03:19.320772 24150 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261120 09:03:19.329293 24150 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20261120 09:03:19.329420 24150 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261120 09:03:19.329552 24150 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20261120 09:03:19.329640 24150 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20261120 09:03:19.339564 24150 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.79.84:36147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:38755
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.79.126:41659
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.79.126
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 36b6772d828145f8fbba3c49746c86838683f9ba
build type FASTDEBUG
built by None at 20 Nov 2026 08:44:26 UTC on bdcb31816ec0
build id 14873
ASAN enabled
I20261120 09:03:19.341234 24150 env_posix.cc:2337] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261120 09:03:19.343111 24150 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261120 09:03:19.351780 24156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261120 09:03:19.351740 24155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261120 09:03:19.352559 24158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261120 09:03:19.353246 24150 server_base.cc:1061] running on GCE node
I20261120 09:03:19.354015 24150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261120 09:03:19.355463 24150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261120 09:03:19.356668 24150 hybrid_clock.cc:648] HybridClock initialized: now 1795165399356623 us; error 40 us; skew 500 ppm
I20261120 09:03:19.357016 24150 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261120 09:03:19.359192 24150 webserver.cc:577] Webserver started at http://127.23.79.126:33973/ using document root <none> and password file <none>
I20261120 09:03:19.359891 24150 fs_manager.cc:362] Metadata directory not provided
I20261120 09:03:19.360018 24150 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261120 09:03:19.360378 24150 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261120 09:03:19.362766 24150 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data/instance:
uuid: "a99947e985094a3e8999fe2aa4e23f18"
format_stamp: "Formatted at 2026-11-20 09:03:19 on dist-test-slave-vzd6"
I20261120 09:03:19.363591 24150 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/wal/instance:
uuid: "a99947e985094a3e8999fe2aa4e23f18"
format_stamp: "Formatted at 2026-11-20 09:03:19 on dist-test-slave-vzd6"
I20261120 09:03:19.368685 24150 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20261120 09:03:19.372129 24164 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261120 09:03:19.373497 24150 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20261120 09:03:19.373672 24150 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data,/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/wal
uuid: "a99947e985094a3e8999fe2aa4e23f18"
format_stamp: "Formatted at 2026-11-20 09:03:19 on dist-test-slave-vzd6"
I20261120 09:03:19.373880 24150 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261120 09:03:19.391618 24150 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261120 09:03:19.392547 24150 env_posix.cc:2337] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261120 09:03:19.392822 24150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261120 09:03:19.412472 24150 rpc_server.cc:307] RPC server started. Bound to: 127.23.79.126:41659
I20261120 09:03:19.412496 24215 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.79.126:41659 every 8 connection(s)
I20261120 09:03:19.414047 24150 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data/info.pb
I20261120 09:03:19.418403 24216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:19.419713 23869 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu as pid 24150
I20261120 09:03:19.419992 23869 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/wal/instance
I20261120 09:03:19.422374 23869 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu
/tmp/dist-test-taskH9EWc6/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.79.125:45319
--webserver_interface=127.23.79.125
--webserver_port=0
--builtin_ntp_servers=127.23.79.84:36147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881
--hive_metastore_uris=thrift://127.0.0.1:38755
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20261120 09:03:19.424059 24216 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } has no permanent_uuid. Determining permanent_uuid...
I20261120 09:03:19.446343 24216 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } has no permanent_uuid. Determining permanent_uuid...
W20261120 09:03:19.447570 24167 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:03:19.449119 24216 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.79.125:45319: Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:03:19.498476 24216 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } attempt: 1
W20261120 09:03:19.500726 24216 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.79.125:45319: Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:03:19.569106 24216 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } attempt: 2
W20261120 09:03:19.571235 24216 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.79.125:45319: Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:03:19.662555 24216 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } attempt: 3
W20261120 09:03:19.664623 24216 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.79.125:45319: Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:03:19.749763 24217 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261120 09:03:19.750074 24217 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261120 09:03:19.750144 24217 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261120 09:03:19.759428 24217 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20261120 09:03:19.759526 24217 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261120 09:03:19.759578 24217 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20261120 09:03:19.759624 24217 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20261120 09:03:19.770872 24217 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.79.84:36147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:38755
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.79.125:45319
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.23.79.125
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 36b6772d828145f8fbba3c49746c86838683f9ba
build type FASTDEBUG
built by None at 20 Nov 2026 08:44:26 UTC on bdcb31816ec0
build id 14873
ASAN enabled
I20261120 09:03:19.772644 24217 env_posix.cc:2337] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261120 09:03:19.774516 24217 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261120 09:03:19.783516 24226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261120 09:03:19.783874 24225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261120 09:03:19.784574 24228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261120 09:03:19.785738 24217 server_base.cc:1061] running on GCE node
I20261120 09:03:19.786656 24217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261120 09:03:19.788203 24217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261120 09:03:19.789443 24217 hybrid_clock.cc:648] HybridClock initialized: now 1795165399789390 us; error 42 us; skew 500 ppm
I20261120 09:03:19.789809 24217 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261120 09:03:19.792083 24217 webserver.cc:577] Webserver started at http://127.23.79.125:34819/ using document root <none> and password file <none>
I20261120 09:03:19.792814 24217 fs_manager.cc:362] Metadata directory not provided
I20261120 09:03:19.792940 24217 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261120 09:03:19.793326 24217 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261120 09:03:19.795984 24217 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-1/data/instance:
uuid: "d2b1940991ac40bd916579d581e689f4"
format_stamp: "Formatted at 2026-11-20 09:03:19 on dist-test-slave-vzd6"
I20261120 09:03:19.796808 24217 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-1/wal/instance:
uuid: "d2b1940991ac40bd916579d581e689f4"
format_stamp: "Formatted at 2026-11-20 09:03:19 on dist-test-slave-vzd6"
I20261120 09:03:19.802703 24217 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20261120 09:03:19.806203 24234 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261120 09:03:19.807608 24217 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20261120 09:03:19.807780 24217 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-1/data,/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-1/wal
uuid: "d2b1940991ac40bd916579d581e689f4"
format_stamp: "Formatted at 2026-11-20 09:03:19 on dist-test-slave-vzd6"
I20261120 09:03:19.807912 24216 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } attempt: 4
I20261120 09:03:19.808063 24217 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20261120 09:03:19.809801 24216 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.79.125:45319: Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:03:19.825035 24217 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261120 09:03:19.825996 24217 env_posix.cc:2337] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261120 09:03:19.826282 24217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261120 09:03:19.846386 24217 rpc_server.cc:307] RPC server started. Bound to: 127.23.79.125:45319
I20261120 09:03:19.846405 24285 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.79.125:45319 every 8 connection(s)
I20261120 09:03:19.847944 24217 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-1/data/info.pb
I20261120 09:03:19.849520 23869 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu as pid 24217
I20261120 09:03:19.849737 23869 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-1/wal/instance
I20261120 09:03:19.850904 23869 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu
/tmp/dist-test-taskH9EWc6/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.79.124:33881
--webserver_interface=127.23.79.124
--webserver_port=0
--builtin_ntp_servers=127.23.79.84:36147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881
--hive_metastore_uris=thrift://127.0.0.1:38755
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20261120 09:03:19.852330 24286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:19.858144 24286 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } has no permanent_uuid. Determining permanent_uuid...
I20261120 09:03:19.871308 24286 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } has no permanent_uuid. Determining permanent_uuid...
I20261120 09:03:19.880524 24286 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } has no permanent_uuid. Determining permanent_uuid...
W20261120 09:03:19.881848 24235 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.124:33881: connect: Connection refused (error 111)
W20261120 09:03:19.883546 24286 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.79.124:33881: Network error: Client connection negotiation failed: client connection to 127.23.79.124:33881: connect: Connection refused (error 111)
I20261120 09:03:19.932878 24286 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } attempt: 1
W20261120 09:03:19.935125 24286 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.79.124:33881: Network error: Client connection negotiation failed: client connection to 127.23.79.124:33881: connect: Connection refused (error 111)
I20261120 09:03:20.003376 24286 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } attempt: 2
W20261120 09:03:20.005580 24286 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.79.124:33881: Network error: Client connection negotiation failed: client connection to 127.23.79.124:33881: connect: Connection refused (error 111)
I20261120 09:03:20.096822 24286 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } attempt: 3
W20261120 09:03:20.099131 24286 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.79.124:33881: Network error: Client connection negotiation failed: client connection to 127.23.79.124:33881: connect: Connection refused (error 111)
I20261120 09:03:20.109059 24216 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } attempt: 5
I20261120 09:03:20.115852 24216 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } has no permanent_uuid. Determining permanent_uuid...
W20261120 09:03:20.117754 24216 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.79.124:33881: Network error: Client connection negotiation failed: client connection to 127.23.79.124:33881: connect: Connection refused (error 111)
I20261120 09:03:20.168987 24216 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } attempt: 1
W20261120 09:03:20.170984 24216 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.79.124:33881: Network error: Client connection negotiation failed: client connection to 127.23.79.124:33881: connect: Connection refused (error 111)
W20261120 09:03:20.193259 24287 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261120 09:03:20.193590 24287 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261120 09:03:20.193727 24287 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261120 09:03:20.202373 24287 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20261120 09:03:20.202473 24287 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261120 09:03:20.202596 24287 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20261120 09:03:20.202688 24287 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20261120 09:03:20.212801 24287 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.79.84:36147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:38755
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.79.124:33881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.23.79.124
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 36b6772d828145f8fbba3c49746c86838683f9ba
build type FASTDEBUG
built by None at 20 Nov 2026 08:44:26 UTC on bdcb31816ec0
build id 14873
ASAN enabled
I20261120 09:03:20.214586 24287 env_posix.cc:2337] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261120 09:03:20.216333 24287 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261120 09:03:20.224166 24296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261120 09:03:20.224139 24295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261120 09:03:20.224762 24298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261120 09:03:20.225440 24287 server_base.cc:1061] running on GCE node
I20261120 09:03:20.226110 24287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261120 09:03:20.227589 24287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261120 09:03:20.228777 24287 hybrid_clock.cc:648] HybridClock initialized: now 1795165400228715 us; error 55 us; skew 500 ppm
I20261120 09:03:20.229095 24287 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261120 09:03:20.231184 24287 webserver.cc:577] Webserver started at http://127.23.79.124:39545/ using document root <none> and password file <none>
I20261120 09:03:20.231865 24287 fs_manager.cc:362] Metadata directory not provided
I20261120 09:03:20.231978 24287 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261120 09:03:20.232331 24287 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261120 09:03:20.234591 24287 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data/instance:
uuid: "d82bf27d60fa450e8f941d1a9d36a825"
format_stamp: "Formatted at 2026-11-20 09:03:20 on dist-test-slave-vzd6"
I20261120 09:03:20.235385 24287 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/wal/instance:
uuid: "d82bf27d60fa450e8f941d1a9d36a825"
format_stamp: "Formatted at 2026-11-20 09:03:20 on dist-test-slave-vzd6"
I20261120 09:03:20.239238 24216 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } attempt: 2
I20261120 09:03:20.240803 24287 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
W20261120 09:03:20.241110 24216 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.79.124:33881: Network error: Client connection negotiation failed: client connection to 127.23.79.124:33881: connect: Connection refused (error 111)
I20261120 09:03:20.242369 24286 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } attempt: 4
W20261120 09:03:20.244267 24286 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.79.124:33881: Network error: Client connection negotiation failed: client connection to 127.23.79.124:33881: connect: Connection refused (error 111)
I20261120 09:03:20.244565 24304 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261120 09:03:20.246172 24287 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20261120 09:03:20.246344 24287 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data,/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/wal
uuid: "d82bf27d60fa450e8f941d1a9d36a825"
format_stamp: "Formatted at 2026-11-20 09:03:20 on dist-test-slave-vzd6"
I20261120 09:03:20.246610 24287 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261120 09:03:20.270234 24287 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261120 09:03:20.271272 24287 env_posix.cc:2337] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261120 09:03:20.271567 24287 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261120 09:03:20.292209 24287 rpc_server.cc:307] RPC server started. Bound to: 127.23.79.124:33881
I20261120 09:03:20.292232 24355 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.79.124:33881 every 8 connection(s)
I20261120 09:03:20.294039 24287 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data/info.pb
I20261120 09:03:20.298067 23869 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu as pid 24287
I20261120 09:03:20.298265 23869 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/wal/instance
I20261120 09:03:20.299043 24356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:20.306306 24356 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } has no permanent_uuid. Determining permanent_uuid...
I20261120 09:03:20.319929 24356 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } has no permanent_uuid. Determining permanent_uuid...
I20261120 09:03:20.327368 24356 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } has no permanent_uuid. Determining permanent_uuid...
I20261120 09:03:20.340423 24356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: Bootstrap starting.
I20261120 09:03:20.343551 24356 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:20.344769 24356 log.cc:826] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: Log is configured to *not* fsync() on all Append() calls
I20261120 09:03:20.347157 24356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: No bootstrap required, opened a new log
I20261120 09:03:20.347313 24216 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } attempt: 3
I20261120 09:03:20.354271 24356 raft_consensus.cc:366] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:20.354686 24356 raft_consensus.cc:392] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:20.354815 24356 raft_consensus.cc:787] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d82bf27d60fa450e8f941d1a9d36a825, State: Initialized, Role: FOLLOWER
I20261120 09:03:20.355516 24356 consensus_queue.cc:261] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:20.356416 24364 sys_catalog.cc:455] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:20.356671 24364 sys_catalog.cc:458] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:20.357807 24356 sys_catalog.cc:565] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: configured and running, proceeding with master startup.
I20261120 09:03:20.358491 24216 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: Bootstrap starting.
I20261120 09:03:20.363224 24216 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:20.364975 24216 log.cc:826] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: Log is configured to *not* fsync() on all Append() calls
I20261120 09:03:20.366274 24378 catalog_manager.cc:820] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20261120 09:03:20.370690 24216 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: No bootstrap required, opened a new log
I20261120 09:03:20.368881 24287 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: OK, instance_id { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" instance_seqno: 1795165399407064 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20261120 09:03:20.374761 24287 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:03:20.378044 24216 raft_consensus.cc:366] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:20.378530 24216 raft_consensus.cc:392] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:20.378707 24216 raft_consensus.cc:787] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99947e985094a3e8999fe2aa4e23f18, State: Initialized, Role: FOLLOWER
I20261120 09:03:20.379490 24216 consensus_queue.cc:261] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:20.380513 24381 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:20.380853 24381 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:20.381675 24216 sys_catalog.cc:565] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: configured and running, proceeding with master startup.
W20261120 09:03:20.395499 24170 tablet.cc:2554] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20261120 09:03:20.421669 24397 catalog_manager.cc:820] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20261120 09:03:20.426818 24150 master_runner.cc:187] Error getting master registration for 127.23.79.125:45319: OK, instance_id { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" instance_seqno: 1795165399841113 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20261120 09:03:20.432928 24150 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20261120 09:03:20.523739 24310 tablet.cc:2554] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20261120 09:03:20.543514 24286 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } attempt: 5
I20261120 09:03:20.553268 24286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4: Bootstrap starting.
I20261120 09:03:20.556572 24286 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:20.556509 24381 raft_consensus.cc:534] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:20.556771 24381 raft_consensus.cc:556] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:20.557943 24286 log.cc:826] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4: Log is configured to *not* fsync() on all Append() calls
I20261120 09:03:20.558574 24381 leader_election.cc:290] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319), d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881)
I20261120 09:03:20.559667 24331 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a99947e985094a3e8999fe2aa4e23f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d82bf27d60fa450e8f941d1a9d36a825" is_pre_election: true
I20261120 09:03:20.560271 24331 raft_consensus.cc:2062] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate a99947e985094a3e8999fe2aa4e23f18 in term 0
I20261120 09:03:20.560936 24286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4: No bootstrap required, opened a new log
I20261120 09:03:20.560887 24165 leader_election.cc:304] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99947e985094a3e8999fe2aa4e23f18, d82bf27d60fa450e8f941d1a9d36a825; no voters: 
I20261120 09:03:20.561265 24381 raft_consensus.cc:3024] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261120 09:03:20.561427 24381 raft_consensus.cc:534] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261120 09:03:20.561554 24381 raft_consensus.cc:3296] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:20.562283 24381 raft_consensus.cc:556] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:20.566013 24381 leader_election.cc:290] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 1 election: Requested vote from peers d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319), d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881)
I20261120 09:03:20.566555 24331 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a99947e985094a3e8999fe2aa4e23f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d82bf27d60fa450e8f941d1a9d36a825"
I20261120 09:03:20.566745 24331 raft_consensus.cc:3296] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:20.567209 24331 raft_consensus.cc:2062] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate a99947e985094a3e8999fe2aa4e23f18 in term 1
I20261120 09:03:20.567852 24286 raft_consensus.cc:366] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:20.568190 24286 raft_consensus.cc:392] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:20.568312 24286 raft_consensus.cc:787] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2b1940991ac40bd916579d581e689f4, State: Initialized, Role: FOLLOWER
I20261120 09:03:20.569031 24286 consensus_queue.cc:261] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:20.570015 24400 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:20.570302 24400 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:20.570487 24165 leader_election.cc:304] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a99947e985094a3e8999fe2aa4e23f18, d82bf27d60fa450e8f941d1a9d36a825; no voters: 
I20261120 09:03:20.570838 24381 raft_consensus.cc:3024] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 1 FOLLOWER]: Leader election won for term 1
I20261120 09:03:20.570998 24381 raft_consensus.cc:744] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 1 LEADER]: Becoming Leader. State: Replica: a99947e985094a3e8999fe2aa4e23f18, State: Running, Role: LEADER
I20261120 09:03:20.571401 24286 sys_catalog.cc:565] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [sys.catalog]: configured and running, proceeding with master startup.
I20261120 09:03:20.571450 24381 consensus_queue.cc:238] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:20.573374 24260 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a99947e985094a3e8999fe2aa4e23f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2b1940991ac40bd916579d581e689f4"
I20261120 09:03:20.573920 24260 raft_consensus.cc:3296] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:20.574635 24260 raft_consensus.cc:2062] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate a99947e985094a3e8999fe2aa4e23f18 in term 1
I20261120 09:03:20.574860 24261 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a99947e985094a3e8999fe2aa4e23f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2b1940991ac40bd916579d581e689f4" is_pre_election: true
I20261120 09:03:20.575438 24261 raft_consensus.cc:2612] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 1 FOLLOWER]: Leader pre-election vote request: already granted 'yes' vote to a99947e985094a3e8999fe2aa4e23f18 in term 1; re-sending same reply
I20261120 09:03:20.576414 24399 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a99947e985094a3e8999fe2aa4e23f18. Latest consensus state: current_term: 1 leader_uuid: "a99947e985094a3e8999fe2aa4e23f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:20.576656 24399 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: This master's current role is: LEADER
I20261120 09:03:20.577615 24413 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
W20261120 09:03:20.578764 24240 tablet.cc:2554] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20261120 09:03:20.580000 24399 consensus_queue.cc:1049] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:20.583026 24381 consensus_queue.cc:1049] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:20.588799 24413 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261120 09:03:20.592581 24364 sys_catalog.cc:455] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a99947e985094a3e8999fe2aa4e23f18. Latest consensus state: current_term: 1 leader_uuid: "a99947e985094a3e8999fe2aa4e23f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:20.592895 24364 sys_catalog.cc:458] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:20.604099 24400 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a99947e985094a3e8999fe2aa4e23f18. Latest consensus state: current_term: 1 leader_uuid: "a99947e985094a3e8999fe2aa4e23f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:20.604481 24400 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:20.607859 24400 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a99947e985094a3e8999fe2aa4e23f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:20.608151 24400 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:20.615509 24399 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a99947e985094a3e8999fe2aa4e23f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:20.615744 24399 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: This master's current role is: LEADER
I20261120 09:03:20.615999 24399 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a99947e985094a3e8999fe2aa4e23f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:20.616166 24399 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: This master's current role is: LEADER
I20261120 09:03:20.617954 24424 catalog_manager.cc:820] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20261120 09:03:20.624015 24364 sys_catalog.cc:455] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a99947e985094a3e8999fe2aa4e23f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:20.624239 24364 sys_catalog.cc:458] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:20.644793 24413 catalog_manager.cc:1398] Generated new cluster ID: b96ccaeeefb845f4962e35569b62531b
I20261120 09:03:20.644937 24413 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261120 09:03:20.678192 24413 catalog_manager.cc:1421] Generated new certificate authority record
I20261120 09:03:20.679970 24413 catalog_manager.cc:1555] Loading token signing keys...
I20261120 09:03:20.702121 24413 catalog_manager.cc:6237] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: Generated new TSK 0
I20261120 09:03:20.703277 24413 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261120 09:03:20.704571 24413 catalog_manager.cc:1578] Loading latest processed Hive Metastore notification log event ID...
I20261120 09:03:20.705694 24413 catalog_manager.cc:6086] Last processed Hive Metastore notification event ID: -1
I20261120 09:03:20.732980 23869 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu
/tmp/dist-test-taskH9EWc6/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.79.65:0
--local_ip_for_outbound_sockets=127.23.79.65
--webserver_interface=127.23.79.65
--webserver_port=0
--tserver_master_addrs=127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881
--builtin_ntp_servers=127.23.79.84:36147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20261120 09:03:21.070683 24428 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261120 09:03:21.070984 24428 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261120 09:03:21.071141 24428 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261120 09:03:21.079574 24428 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261120 09:03:21.079818 24428 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.79.65
I20261120 09:03:21.090338 24428 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.79.84:36147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.79.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.79.65
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.79.65

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 36b6772d828145f8fbba3c49746c86838683f9ba
build type FASTDEBUG
built by None at 20 Nov 2026 08:44:26 UTC on bdcb31816ec0
build id 14873
ASAN enabled
I20261120 09:03:21.092087 24428 env_posix.cc:2337] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261120 09:03:21.093952 24428 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261120 09:03:21.103978 24433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261120 09:03:21.104017 24434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261120 09:03:21.104791 24436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261120 09:03:21.105131 24428 server_base.cc:1061] running on GCE node
I20261120 09:03:21.105731 24428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261120 09:03:21.106732 24428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261120 09:03:21.107967 24428 hybrid_clock.cc:648] HybridClock initialized: now 1795165401107909 us; error 50 us; skew 500 ppm
I20261120 09:03:21.108321 24428 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261120 09:03:21.110448 24428 webserver.cc:577] Webserver started at http://127.23.79.65:43563/ using document root <none> and password file <none>
I20261120 09:03:21.111213 24428 fs_manager.cc:362] Metadata directory not provided
I20261120 09:03:21.111323 24428 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261120 09:03:21.111681 24428 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261120 09:03:21.114104 24428 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-0/data/instance:
uuid: "2c3fe57b9d2c424da181281af303f3c3"
format_stamp: "Formatted at 2026-11-20 09:03:21 on dist-test-slave-vzd6"
I20261120 09:03:21.115047 24428 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-0/wal/instance:
uuid: "2c3fe57b9d2c424da181281af303f3c3"
format_stamp: "Formatted at 2026-11-20 09:03:21 on dist-test-slave-vzd6"
I20261120 09:03:21.120381 24428 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20261120 09:03:21.123454 24442 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261120 09:03:21.124878 24428 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20261120 09:03:21.125027 24428 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-0/wal
uuid: "2c3fe57b9d2c424da181281af303f3c3"
format_stamp: "Formatted at 2026-11-20 09:03:21 on dist-test-slave-vzd6"
I20261120 09:03:21.125248 24428 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261120 09:03:21.165150 24428 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261120 09:03:21.166008 24428 env_posix.cc:2337] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261120 09:03:21.166275 24428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261120 09:03:21.167217 24428 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261120 09:03:21.168927 24428 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261120 09:03:21.169041 24428 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261120 09:03:21.169195 24428 ts_tablet_manager.cc:662] Registered 0 tablets
I20261120 09:03:21.169296 24428 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261120 09:03:21.203100 24536 raft_consensus.cc:534] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:03:21.203323 24536 raft_consensus.cc:556] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:21.204748 24536 leader_election.cc:290] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881)
I20261120 09:03:21.205451 24330 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d2b1940991ac40bd916579d581e689f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d82bf27d60fa450e8f941d1a9d36a825" is_pre_election: true
I20261120 09:03:21.205771 24330 raft_consensus.cc:2062] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 1 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate d2b1940991ac40bd916579d581e689f4 in term 1
I20261120 09:03:21.205855 24538 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:03:21.205960 24191 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d2b1940991ac40bd916579d581e689f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99947e985094a3e8999fe2aa4e23f18" is_pre_election: true
I20261120 09:03:21.205986 24538 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:21.206436 24235 leader_election.cc:304] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2b1940991ac40bd916579d581e689f4, d82bf27d60fa450e8f941d1a9d36a825; no voters: 
I20261120 09:03:21.206856 24536 raft_consensus.cc:3024] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20261120 09:03:21.206971 24536 raft_consensus.cc:534] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:03:21.207101 24536 raft_consensus.cc:3296] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 1 FOLLOWER]: Advancing to term 2
I20261120 09:03:21.208107 24260 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d82bf27d60fa450e8f941d1a9d36a825" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d2b1940991ac40bd916579d581e689f4" is_pre_election: true
I20261120 09:03:21.208519 24538 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
I20261120 09:03:21.208555 24191 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d82bf27d60fa450e8f941d1a9d36a825" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99947e985094a3e8999fe2aa4e23f18" is_pre_election: true
I20261120 09:03:21.208951 24536 raft_consensus.cc:556] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:21.209383 24260 raft_consensus.cc:2628] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d82bf27d60fa450e8f941d1a9d36a825 in current term 2: Already voted for candidate d2b1940991ac40bd916579d581e689f4 in this term.
I20261120 09:03:21.210280 24307 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:03:21.211035 24538 raft_consensus.cc:3296] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 1 FOLLOWER]: Advancing to term 2
I20261120 09:03:21.211553 24538 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261120 09:03:21.212553 24536 leader_election.cc:290] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [CANDIDATE]: Term 2 election: Requested vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881)
I20261120 09:03:21.212914 24191 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d2b1940991ac40bd916579d581e689f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a99947e985094a3e8999fe2aa4e23f18"
I20261120 09:03:21.213330 24330 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d2b1940991ac40bd916579d581e689f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d82bf27d60fa450e8f941d1a9d36a825"
I20261120 09:03:21.213745 24330 raft_consensus.cc:2062] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 2 FOLLOWER]: Leader election vote request: granting yes vote for candidate d2b1940991ac40bd916579d581e689f4 in term 2
I20261120 09:03:21.218941 24235 leader_election.cc:304] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2b1940991ac40bd916579d581e689f4, d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18
I20261120 09:03:21.219261 24539 raft_consensus.cc:3024] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 2 FOLLOWER]: Leader election won for term 2
I20261120 09:03:21.219421 24539 raft_consensus.cc:744] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 2 LEADER]: Becoming Leader. State: Replica: d2b1940991ac40bd916579d581e689f4, State: Running, Role: LEADER
I20261120 09:03:21.219883 24539 consensus_queue.cc:238] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:21.220712 24428 rpc_server.cc:307] RPC server started. Bound to: 127.23.79.65:40677
I20261120 09:03:21.220763 24558 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.79.65:40677 every 8 connection(s)
I20261120 09:03:21.221360 24536 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2b1940991ac40bd916579d581e689f4. Latest consensus state: current_term: 2 leader_uuid: "d2b1940991ac40bd916579d581e689f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:21.221547 24536 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [sys.catalog]: This master's current role is: LEADER
I20261120 09:03:21.222690 24428 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-0/data/info.pb
I20261120 09:03:21.223161 24330 raft_consensus.cc:1338] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 2 FOLLOWER]: Refusing update from remote peer d2b1940991ac40bd916579d581e689f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20261120 09:03:21.231333 24191 raft_consensus.cc:3291] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 1 LEADER]: Stepping down as leader of term 1
I20261120 09:03:21.231482 24191 raft_consensus.cc:787] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a99947e985094a3e8999fe2aa4e23f18, State: Running, Role: LEADER
I20261120 09:03:21.231858 23869 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu as pid 24428
I20261120 09:03:21.231854 24191 consensus_queue.cc:261] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:21.232048 23869 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-0/wal/instance
I20261120 09:03:21.232404 24191 raft_consensus.cc:3296] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 1 FOLLOWER]: Advancing to term 2
I20261120 09:03:21.236955 24560 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261120 09:03:21.237257 24536 consensus_queue.cc:1049] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20261120 09:03:21.249307 24191 raft_consensus.cc:1338] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 2 FOLLOWER]: Refusing update from remote peer d2b1940991ac40bd916579d581e689f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20261120 09:03:21.252170 24559 consensus_queue.cc:1049] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20261120 09:03:21.254238 24560 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261120 09:03:21.256102 24560 catalog_manager.cc:1310] Loaded cluster ID: b96ccaeeefb845f4962e35569b62531b
I20261120 09:03:21.256212 24560 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261120 09:03:21.274652 24560 catalog_manager.cc:1555] Loading token signing keys...
W20261120 09:03:21.275112 24235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.79.124:33881, user_credentials={real_user=slave}} blocked reactor thread for 51175.4us
I20261120 09:03:21.276844 24560 catalog_manager.cc:6248] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4: Loaded TSK: 0
I20261120 09:03:21.279482 24538 sys_catalog.cc:455] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "d2b1940991ac40bd916579d581e689f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:21.279737 24538 sys_catalog.cc:458] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:21.279909 24544 sys_catalog.cc:455] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2b1940991ac40bd916579d581e689f4. Latest consensus state: current_term: 2 leader_uuid: "d2b1940991ac40bd916579d581e689f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:21.280153 24544 sys_catalog.cc:458] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:21.280532 24560 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261120 09:03:21.281936 24560 catalog_manager.cc:1578] Loading latest processed Hive Metastore notification log event ID...
I20261120 09:03:21.281971 24573 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2b1940991ac40bd916579d581e689f4. Latest consensus state: current_term: 2 leader_uuid: "d2b1940991ac40bd916579d581e689f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:21.283601 24573 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:21.283955 24573 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "d2b1940991ac40bd916579d581e689f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:21.284221 24573 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:21.290032 24560 catalog_manager.cc:6086] Last processed Hive Metastore notification event ID: -1
I20261120 09:03:21.290025 24536 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "d2b1940991ac40bd916579d581e689f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:21.290261 24536 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [sys.catalog]: This master's current role is: LEADER
I20261120 09:03:21.290040 24559 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "d2b1940991ac40bd916579d581e689f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:21.290385 24559 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [sys.catalog]: This master's current role is: LEADER
I20261120 09:03:21.299537 23869 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu
/tmp/dist-test-taskH9EWc6/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.79.66:0
--local_ip_for_outbound_sockets=127.23.79.66
--webserver_interface=127.23.79.66
--webserver_port=0
--tserver_master_addrs=127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881
--builtin_ntp_servers=127.23.79.84:36147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20261120 09:03:21.309799 24568 heartbeater.cc:345] Connected to a master server at 127.23.79.126:41659
I20261120 09:03:21.310181 24568 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:21.311444 24568 heartbeater.cc:508] Master 127.23.79.126:41659 requested a full tablet report, sending...
I20261120 09:03:21.314183 24181 ts_manager.cc:210] Registered new tserver with Master: 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:21.320091 24562 heartbeater.cc:345] Connected to a master server at 127.23.79.124:33881
I20261120 09:03:21.320267 24562 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:21.320824 24562 heartbeater.cc:508] Master 127.23.79.124:33881 requested a full tablet report, sending...
I20261120 09:03:21.322752 24321 ts_manager.cc:210] Registered new tserver with Master: 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:21.327788 24574 heartbeater.cc:345] Connected to a master server at 127.23.79.125:45319
I20261120 09:03:21.327932 24574 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:21.328385 24574 heartbeater.cc:508] Master 127.23.79.125:45319 requested a full tablet report, sending...
I20261120 09:03:21.330022 24251 ts_manager.cc:210] Registered new tserver with Master: 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:21.332265 24251 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.23.79.65:57239
I20261120 09:03:21.371516 24378 catalog_manager.cc:1310] Loaded cluster ID: b96ccaeeefb845f4962e35569b62531b
I20261120 09:03:21.371738 24378 catalog_manager.cc:1603] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: loading cluster ID for follower catalog manager: success
I20261120 09:03:21.375898 24378 catalog_manager.cc:1625] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: acquiring CA information for follower catalog manager: success
I20261120 09:03:21.378451 24378 catalog_manager.cc:1653] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20261120 09:03:21.424636 24397 catalog_manager.cc:1653] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20261120 09:03:21.782816 24579 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261120 09:03:21.783272 24579 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261120 09:03:21.783398 24579 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261120 09:03:21.796978 24579 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261120 09:03:21.797333 24579 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.79.66
I20261120 09:03:21.811826 24579 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.79.84:36147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.79.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.79.66
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.79.66

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 36b6772d828145f8fbba3c49746c86838683f9ba
build type FASTDEBUG
built by None at 20 Nov 2026 08:44:26 UTC on bdcb31816ec0
build id 14873
ASAN enabled
I20261120 09:03:21.813905 24579 env_posix.cc:2337] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261120 09:03:21.815840 24579 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261120 09:03:21.825536 24585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261120 09:03:21.825556 24586 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261120 09:03:21.827354 24588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261120 09:03:21.827888 24579 server_base.cc:1061] running on GCE node
I20261120 09:03:21.828549 24579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261120 09:03:21.829650 24579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261120 09:03:21.830863 24579 hybrid_clock.cc:648] HybridClock initialized: now 1795165401830794 us; error 48 us; skew 500 ppm
I20261120 09:03:21.831192 24579 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261120 09:03:21.833702 24579 webserver.cc:577] Webserver started at http://127.23.79.66:41977/ using document root <none> and password file <none>
I20261120 09:03:21.834642 24579 fs_manager.cc:362] Metadata directory not provided
I20261120 09:03:21.834753 24579 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261120 09:03:21.834935 24574 heartbeater.cc:500] Master 127.23.79.125:45319 was elected leader, sending a full tablet report...
I20261120 09:03:21.835196 24579 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261120 09:03:21.838217 24579 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-1/data/instance:
uuid: "2fb9ff0dc3d849d7bcf95806233d2c62"
format_stamp: "Formatted at 2026-11-20 09:03:21 on dist-test-slave-vzd6"
I20261120 09:03:21.838992 24579 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-1/wal/instance:
uuid: "2fb9ff0dc3d849d7bcf95806233d2c62"
format_stamp: "Formatted at 2026-11-20 09:03:21 on dist-test-slave-vzd6"
I20261120 09:03:21.843906 24579 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.004s
I20261120 09:03:21.847496 24594 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261120 09:03:21.848820 24579 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20261120 09:03:21.848978 24579 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-1/wal
uuid: "2fb9ff0dc3d849d7bcf95806233d2c62"
format_stamp: "Formatted at 2026-11-20 09:03:21 on dist-test-slave-vzd6"
I20261120 09:03:21.849207 24579 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261120 09:03:21.875914 24579 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261120 09:03:21.876864 24579 env_posix.cc:2337] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261120 09:03:21.877148 24579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261120 09:03:21.878171 24579 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261120 09:03:21.880155 24579 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261120 09:03:21.880276 24579 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261120 09:03:21.880410 24579 ts_tablet_manager.cc:662] Registered 0 tablets
I20261120 09:03:21.880503 24579 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261120 09:03:21.913089 24579 rpc_server.cc:307] RPC server started. Bound to: 127.23.79.66:38879
I20261120 09:03:21.913180 24706 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.79.66:38879 every 8 connection(s)
I20261120 09:03:21.914793 24579 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-1/data/info.pb
I20261120 09:03:21.920686 23869 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu as pid 24579
I20261120 09:03:21.920902 23869 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-1/wal/instance
I20261120 09:03:21.930899 23869 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu
/tmp/dist-test-taskH9EWc6/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.79.67:0
--local_ip_for_outbound_sockets=127.23.79.67
--webserver_interface=127.23.79.67
--webserver_port=0
--tserver_master_addrs=127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881
--builtin_ntp_servers=127.23.79.84:36147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20261120 09:03:21.953642 24707 heartbeater.cc:345] Connected to a master server at 127.23.79.124:33881
I20261120 09:03:21.954128 24707 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:21.954162 24708 heartbeater.cc:345] Connected to a master server at 127.23.79.126:41659
I20261120 09:03:21.954342 24708 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:21.955523 24707 heartbeater.cc:508] Master 127.23.79.124:33881 requested a full tablet report, sending...
I20261120 09:03:21.956055 24708 heartbeater.cc:508] Master 127.23.79.126:41659 requested a full tablet report, sending...
I20261120 09:03:21.956507 24709 heartbeater.cc:345] Connected to a master server at 127.23.79.125:45319
I20261120 09:03:21.956631 24709 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:21.957080 24709 heartbeater.cc:508] Master 127.23.79.125:45319 requested a full tablet report, sending...
I20261120 09:03:21.957489 24181 ts_manager.cc:210] Registered new tserver with Master: 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879)
I20261120 09:03:21.957769 24321 ts_manager.cc:210] Registered new tserver with Master: 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879)
I20261120 09:03:21.958250 24251 ts_manager.cc:210] Registered new tserver with Master: 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879)
I20261120 09:03:21.959167 24251 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.23.79.66:52173
I20261120 09:03:22.139165 24718 raft_consensus.cc:534] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d2b1940991ac40bd916579d581e689f4)
I20261120 09:03:22.139377 24718 raft_consensus.cc:556] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:22.140137 24718 leader_election.cc:290] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319), d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881)
I20261120 09:03:22.140686 24330 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a99947e985094a3e8999fe2aa4e23f18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d82bf27d60fa450e8f941d1a9d36a825" is_pre_election: true
I20261120 09:03:22.140687 24260 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a99947e985094a3e8999fe2aa4e23f18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d2b1940991ac40bd916579d581e689f4" is_pre_election: true
I20261120 09:03:22.141379 24165 leader_election.cc:304] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99947e985094a3e8999fe2aa4e23f18; no voters: d2b1940991ac40bd916579d581e689f4, d82bf27d60fa450e8f941d1a9d36a825
I20261120 09:03:22.141669 24718 raft_consensus.cc:2966] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20261120 09:03:22.203428 24719 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d2b1940991ac40bd916579d581e689f4)
I20261120 09:03:22.203672 24719 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:22.204437 24719 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
I20261120 09:03:22.205016 24260 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d82bf27d60fa450e8f941d1a9d36a825" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d2b1940991ac40bd916579d581e689f4" is_pre_election: true
I20261120 09:03:22.205062 24190 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d82bf27d60fa450e8f941d1a9d36a825" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99947e985094a3e8999fe2aa4e23f18" is_pre_election: true
I20261120 09:03:22.205348 24190 raft_consensus.cc:2062] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 2 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate d82bf27d60fa450e8f941d1a9d36a825 in term 2
I20261120 09:03:22.205768 24308 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99947e985094a3e8999fe2aa4e23f18, d82bf27d60fa450e8f941d1a9d36a825; no voters: d2b1940991ac40bd916579d581e689f4
I20261120 09:03:22.206025 24719 raft_consensus.cc:3024] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20261120 09:03:22.206190 24719 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d2b1940991ac40bd916579d581e689f4)
I20261120 09:03:22.206276 24719 raft_consensus.cc:3296] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 2 FOLLOWER]: Advancing to term 3
I20261120 09:03:22.206935 24719 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:22.209210 24719 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 3 election: Requested vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
I20261120 09:03:22.209652 24190 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d82bf27d60fa450e8f941d1a9d36a825" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a99947e985094a3e8999fe2aa4e23f18"
I20261120 09:03:22.209838 24260 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d82bf27d60fa450e8f941d1a9d36a825" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d2b1940991ac40bd916579d581e689f4"
I20261120 09:03:22.209910 24190 raft_consensus.cc:3296] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 2 FOLLOWER]: Advancing to term 3
I20261120 09:03:22.210299 24190 raft_consensus.cc:2062] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 3 FOLLOWER]: Leader election vote request: granting yes vote for candidate d82bf27d60fa450e8f941d1a9d36a825 in term 3
I20261120 09:03:22.212365 24191 raft_consensus.cc:1303] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 3 FOLLOWER]: Rejecting Update request from peer d2b1940991ac40bd916579d581e689f4 for earlier term 2. Current term is 3. Ops: []
I20261120 09:03:22.212947 24721 consensus_queue.cc:1060] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20261120 09:03:22.213728 24722 raft_consensus.cc:3291] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 2 LEADER]: Stepping down as leader of term 2
I20261120 09:03:22.213852 24722 raft_consensus.cc:787] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d2b1940991ac40bd916579d581e689f4, State: Running, Role: LEADER
I20261120 09:03:22.213802 24308 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99947e985094a3e8999fe2aa4e23f18, d82bf27d60fa450e8f941d1a9d36a825; no voters: d2b1940991ac40bd916579d581e689f4
I20261120 09:03:22.214178 24719 raft_consensus.cc:3024] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 3 FOLLOWER]: Leader election won for term 3
I20261120 09:03:22.214411 24719 raft_consensus.cc:744] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 3 LEADER]: Becoming Leader. State: Replica: d82bf27d60fa450e8f941d1a9d36a825, State: Running, Role: LEADER
I20261120 09:03:22.214231 24722 consensus_queue.cc:261] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:22.214877 24722 raft_consensus.cc:3296] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 2 FOLLOWER]: Advancing to term 3
I20261120 09:03:22.214915 24719 consensus_queue.cc:238] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:22.217197 24720 sys_catalog.cc:455] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d82bf27d60fa450e8f941d1a9d36a825. Latest consensus state: current_term: 3 leader_uuid: "d82bf27d60fa450e8f941d1a9d36a825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:22.217387 24720 sys_catalog.cc:458] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: This master's current role is: LEADER
I20261120 09:03:22.218164 24723 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261120 09:03:22.219043 24260 raft_consensus.cc:1338] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 3 FOLLOWER]: Refusing update from remote peer d82bf27d60fa450e8f941d1a9d36a825: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20261120 09:03:22.219786 24719 consensus_queue.cc:1049] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20261120 09:03:22.219902 24190 raft_consensus.cc:1338] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 3 FOLLOWER]: Refusing update from remote peer d82bf27d60fa450e8f941d1a9d36a825: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20261120 09:03:22.220538 24720 consensus_queue.cc:1049] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20261120 09:03:22.220992 24723 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261120 09:03:22.221951 24723 catalog_manager.cc:1310] Loaded cluster ID: b96ccaeeefb845f4962e35569b62531b
I20261120 09:03:22.221877 24722 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d82bf27d60fa450e8f941d1a9d36a825. Latest consensus state: current_term: 3 leader_uuid: "d82bf27d60fa450e8f941d1a9d36a825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:22.221962 24718 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d82bf27d60fa450e8f941d1a9d36a825. Latest consensus state: current_term: 3 leader_uuid: "d82bf27d60fa450e8f941d1a9d36a825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:22.222087 24722 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:22.222112 24723 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261120 09:03:22.222185 24718 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:22.223723 24723 catalog_manager.cc:1555] Loading token signing keys...
I20261120 09:03:22.224736 24723 catalog_manager.cc:6248] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: Loaded TSK: 0
I20261120 09:03:22.225720 24723 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261120 09:03:22.226722 24723 catalog_manager.cc:1578] Loading latest processed Hive Metastore notification log event ID...
I20261120 09:03:22.227798 24723 catalog_manager.cc:6086] Last processed Hive Metastore notification event ID: -1
I20261120 09:03:22.229851 24722 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "d82bf27d60fa450e8f941d1a9d36a825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:22.230154 24722 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:22.235342 24718 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "d82bf27d60fa450e8f941d1a9d36a825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:22.235565 24718 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:22.236097 24724 sys_catalog.cc:455] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "d82bf27d60fa450e8f941d1a9d36a825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:22.236178 24719 sys_catalog.cc:455] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "d82bf27d60fa450e8f941d1a9d36a825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:22.236317 24724 sys_catalog.cc:458] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: This master's current role is: LEADER
I20261120 09:03:22.236382 24719 sys_catalog.cc:458] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: This master's current role is: LEADER
W20261120 09:03:22.283782 24717 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261120 09:03:22.284082 24717 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261120 09:03:22.284179 24717 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261120 09:03:22.293183 24717 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261120 09:03:22.293459 24717 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.79.67
I20261120 09:03:22.309543 24717 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.79.84:36147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.79.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.79.67
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.79.67

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 36b6772d828145f8fbba3c49746c86838683f9ba
build type FASTDEBUG
built by None at 20 Nov 2026 08:44:26 UTC on bdcb31816ec0
build id 14873
ASAN enabled
I20261120 09:03:22.311573 24717 env_posix.cc:2337] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261120 09:03:22.313309 24717 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261120 09:03:22.322847 24732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261120 09:03:22.323388 24735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261120 09:03:22.323730 24733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261120 09:03:22.324055 24717 server_base.cc:1061] running on GCE node
I20261120 09:03:22.324632 24717 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261120 09:03:22.325532 24717 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261120 09:03:22.326757 24717 hybrid_clock.cc:648] HybridClock initialized: now 1795165402326715 us; error 46 us; skew 500 ppm
I20261120 09:03:22.327073 24717 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261120 09:03:22.329187 24717 webserver.cc:577] Webserver started at http://127.23.79.67:44183/ using document root <none> and password file <none>
I20261120 09:03:22.329890 24717 fs_manager.cc:362] Metadata directory not provided
I20261120 09:03:22.330032 24717 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261120 09:03:22.330392 24717 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261120 09:03:22.332846 24717 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-2/data/instance:
uuid: "8668dad23e404dafb0ac25267f07bd46"
format_stamp: "Formatted at 2026-11-20 09:03:22 on dist-test-slave-vzd6"
I20261120 09:03:22.333616 24717 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-2/wal/instance:
uuid: "8668dad23e404dafb0ac25267f07bd46"
format_stamp: "Formatted at 2026-11-20 09:03:22 on dist-test-slave-vzd6"
I20261120 09:03:22.338928 24717 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20261120 09:03:22.341974 24741 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261120 09:03:22.343379 24717 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20261120 09:03:22.343550 24717 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-2/wal
uuid: "8668dad23e404dafb0ac25267f07bd46"
format_stamp: "Formatted at 2026-11-20 09:03:22 on dist-test-slave-vzd6"
I20261120 09:03:22.343761 24717 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261120 09:03:22.363495 24717 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261120 09:03:22.364389 24717 env_posix.cc:2337] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261120 09:03:22.364661 24717 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261120 09:03:22.365880 24717 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261120 09:03:22.368995 24717 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261120 09:03:22.369127 24717 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20261120 09:03:22.369258 24717 ts_tablet_manager.cc:662] Registered 0 tablets
I20261120 09:03:22.369342 24717 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261120 09:03:22.403324 24717 rpc_server.cc:307] RPC server started. Bound to: 127.23.79.67:41035
I20261120 09:03:22.403465 24853 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.79.67:41035 every 8 connection(s)
I20261120 09:03:22.404812 24717 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-2/data/info.pb
I20261120 09:03:22.406991 23869 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu as pid 24717
I20261120 09:03:22.407195 23869 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-2/wal/instance
I20261120 09:03:22.427867 24855 heartbeater.cc:345] Connected to a master server at 127.23.79.126:41659
I20261120 09:03:22.427894 24856 heartbeater.cc:345] Connected to a master server at 127.23.79.125:45319
I20261120 09:03:22.428264 24856 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:22.428270 24855 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:22.428433 24854 heartbeater.cc:345] Connected to a master server at 127.23.79.124:33881
I20261120 09:03:22.428556 24854 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:22.429636 24856 heartbeater.cc:508] Master 127.23.79.125:45319 requested a full tablet report, sending...
I20261120 09:03:22.429607 24855 heartbeater.cc:508] Master 127.23.79.126:41659 requested a full tablet report, sending...
I20261120 09:03:22.429703 24854 heartbeater.cc:508] Master 127.23.79.124:33881 requested a full tablet report, sending...
I20261120 09:03:22.431564 24251 ts_manager.cc:210] Registered new tserver with Master: 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:22.431586 24181 ts_manager.cc:210] Registered new tserver with Master: 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:22.432883 24321 ts_manager.cc:210] Registered new tserver with Master: 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:22.434836 24321 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.23.79.67:57845
I20261120 09:03:22.437578 23869 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20261120 09:03:22.461153 24709 heartbeater.cc:500] Master 127.23.79.125:45319 was elected leader, sending a full tablet report...
I20261120 09:03:22.474728 24321 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41728:
name: "default.Table_44e6e9d80f3244618eb164246f389566"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:22.475004 24320 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41728:
name: "default.Table_eb77729285254174a498bb17a0adceea"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:22.476377 24319 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41728:
name: "default.Table_d5638af53ccf40f2b367cf74de29e633"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:22.477910 24318 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41728:
name: "default.Table_3fae2942cff544c29c926cc5ed10a06c"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:22.479460 24317 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41728:
name: "default.Table_4bb4f7811f444da2b0eca6ab9e9203dd"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:22.480875 24316 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41728:
name: "default.Table_c97aaa8fd7f446ed8008a6bcecc8b494"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:22.481176 24315 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41728:
name: "default.Table_d68821f474e040e18b4d91fbbd850863"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:22.482056 24314 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41728:
name: "default.Table_b9d5ad28fd144956bd0715d85a6db556"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:22.482311 24313 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41728:
name: "default.Table_d67fc59080cc4194b566604a649aefad"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:22.483618 24312 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41728:
name: "default.Table_b2351eb1045a47feb0ca7b7422706581"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20261120 09:03:22.487207 24321 catalog_manager.cc:7244] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_44e6e9d80f3244618eb164246f389566 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20261120 09:03:22.521600 23869 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu pid 24150
I20261120 09:03:22.523648 24211 generic_service.cc:196] Checking for leaks (request via RPC)
I20261120 09:03:22.621454 24424 catalog_manager.cc:1653] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20261120 09:03:22.729758 23869 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu with pid 24150
W20261120 09:03:22.794914 24308 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:03:22.815673 24308 consensus_peers.cc:597] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 -> Peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Couldn't send request to peer a99947e985094a3e8999fe2aa4e23f18. Status: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20261120 09:03:22.828145 24562 heartbeater.cc:500] Master 127.23.79.124:33881 was elected leader, sending a full tablet report...
W20261120 09:03:22.844318 24568 heartbeater.cc:648] Failed to heartbeat to 127.23.79.126:41659 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
I20261120 09:03:22.937741 24854 heartbeater.cc:500] Master 127.23.79.124:33881 was elected leader, sending a full tablet report...
W20261120 09:03:22.944705 24855 heartbeater.cc:648] Failed to heartbeat to 127.23.79.126:41659 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
I20261120 09:03:22.961024 24707 heartbeater.cc:500] Master 127.23.79.124:33881 was elected leader, sending a full tablet report...
W20261120 09:03:22.985527 24708 heartbeater.cc:648] Failed to heartbeat to 127.23.79.126:41659 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
I20261120 09:03:23.132898 24321 catalog_manager.cc:2218] created HMS catalog entry for table  [id=cb55967ea90e43be8da1354763f7984c]
W20261120 09:03:23.140085 24320 catalog_manager.cc:7244] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_eb77729285254174a498bb17a0adceea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20261120 09:03:23.141733 24319 catalog_manager.cc:7244] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_d5638af53ccf40f2b367cf74de29e633 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20261120 09:03:23.142879 24318 catalog_manager.cc:7244] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_3fae2942cff544c29c926cc5ed10a06c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20261120 09:03:23.144057 24317 catalog_manager.cc:7244] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_4bb4f7811f444da2b0eca6ab9e9203dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20261120 09:03:23.145292 24316 catalog_manager.cc:7244] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_c97aaa8fd7f446ed8008a6bcecc8b494 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20261120 09:03:23.146530 24315 catalog_manager.cc:7244] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_d68821f474e040e18b4d91fbbd850863 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20261120 09:03:23.147689 24314 catalog_manager.cc:7244] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_b9d5ad28fd144956bd0715d85a6db556 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20261120 09:03:23.148835 24313 catalog_manager.cc:7244] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_d67fc59080cc4194b566604a649aefad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20261120 09:03:23.149775 24312 catalog_manager.cc:7244] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_b2351eb1045a47feb0ca7b7422706581 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20261120 09:03:23.189347 24321 catalog_manager.cc:3588] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41728:
table { table_name: "default.Table_44e6e9d80f3244618eb164246f389566" } new_table_name: "default.Table_39131cc9c462405ba3639c841ebfe256" modify_external_catalogs: true
I20261120 09:03:23.213817 24320 catalog_manager.cc:2218] created HMS catalog entry for table  [id=90570e46cebe47eba97e5b980f23e909]
I20261120 09:03:23.218746 24642 tablet_service.cc:1495] Processing CreateTablet for tablet 703a95501e53451ea18439c1651c064d (DEFAULT_TABLE table=default.table_44e6e9d80f3244618eb164246f389566 [id=cb55967ea90e43be8da1354763f7984c]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.220351 24642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 703a95501e53451ea18439c1651c064d. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.224913 24320 catalog_manager.cc:3588] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41728:
table { table_name: "default.Table_eb77729285254174a498bb17a0adceea" } new_table_name: "default.Table_4d5337371cd3454fa5aae228272e5fda" modify_external_catalogs: true
I20261120 09:03:23.228219 24641 tablet_service.cc:1495] Processing CreateTablet for tablet b68f23d363924777ad43e7cbe5981571 (DEFAULT_TABLE table=default.table_eb77729285254174a498bb17a0adceea [id=90570e46cebe47eba97e5b980f23e909]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.228734 24641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b68f23d363924777ad43e7cbe5981571. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.232558 24789 tablet_service.cc:1495] Processing CreateTablet for tablet 703a95501e53451ea18439c1651c064d (DEFAULT_TABLE table=default.table_44e6e9d80f3244618eb164246f389566 [id=cb55967ea90e43be8da1354763f7984c]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.234093 24789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 703a95501e53451ea18439c1651c064d. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.237047 24788 tablet_service.cc:1495] Processing CreateTablet for tablet b68f23d363924777ad43e7cbe5981571 (DEFAULT_TABLE table=default.table_eb77729285254174a498bb17a0adceea [id=90570e46cebe47eba97e5b980f23e909]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.237534 24788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b68f23d363924777ad43e7cbe5981571. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.237540 24490 tablet_service.cc:1495] Processing CreateTablet for tablet 703a95501e53451ea18439c1651c064d (DEFAULT_TABLE table=default.table_44e6e9d80f3244618eb164246f389566 [id=cb55967ea90e43be8da1354763f7984c]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.238857 24489 tablet_service.cc:1495] Processing CreateTablet for tablet b68f23d363924777ad43e7cbe5981571 (DEFAULT_TABLE table=default.table_eb77729285254174a498bb17a0adceea [id=90570e46cebe47eba97e5b980f23e909]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.239528 24489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b68f23d363924777ad43e7cbe5981571. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.242846 24490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 703a95501e53451ea18439c1651c064d. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.268200 24319 catalog_manager.cc:2218] created HMS catalog entry for table  [id=83bafe99e25046a4a43a3739a3ca07a1]
I20261120 09:03:23.271468 24920 tablet_bootstrap.cc:492] T b68f23d363924777ad43e7cbe5981571 P 2c3fe57b9d2c424da181281af303f3c3: Bootstrap starting.
I20261120 09:03:23.273985 24919 tablet_bootstrap.cc:492] T 703a95501e53451ea18439c1651c064d P 2fb9ff0dc3d849d7bcf95806233d2c62: Bootstrap starting.
I20261120 09:03:23.276559 24920 tablet_bootstrap.cc:654] T b68f23d363924777ad43e7cbe5981571 P 2c3fe57b9d2c424da181281af303f3c3: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.278223 24319 catalog_manager.cc:3588] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41728:
table { table_name: "default.Table_d5638af53ccf40f2b367cf74de29e633" } new_table_name: "default.Table_0d4b09a9b1754e38bca62e97c14a0854" modify_external_catalogs: true
I20261120 09:03:23.279677 24918 tablet_bootstrap.cc:492] T b68f23d363924777ad43e7cbe5981571 P 8668dad23e404dafb0ac25267f07bd46: Bootstrap starting.
I20261120 09:03:23.280998 24920 log.cc:826] T b68f23d363924777ad43e7cbe5981571 P 2c3fe57b9d2c424da181281af303f3c3: Log is configured to *not* fsync() on all Append() calls
I20261120 09:03:23.284471 24918 tablet_bootstrap.cc:654] T b68f23d363924777ad43e7cbe5981571 P 8668dad23e404dafb0ac25267f07bd46: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.284678 24489 tablet_service.cc:1495] Processing CreateTablet for tablet b4a7f651c19e4912a8e0ea4b1bc2d319 (DEFAULT_TABLE table=default.table_d5638af53ccf40f2b367cf74de29e633 [id=83bafe99e25046a4a43a3739a3ca07a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.285386 24788 tablet_service.cc:1495] Processing CreateTablet for tablet b4a7f651c19e4912a8e0ea4b1bc2d319 (DEFAULT_TABLE table=default.table_d5638af53ccf40f2b367cf74de29e633 [id=83bafe99e25046a4a43a3739a3ca07a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.285797 24788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a7f651c19e4912a8e0ea4b1bc2d319. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.286643 24642 tablet_service.cc:1495] Processing CreateTablet for tablet b4a7f651c19e4912a8e0ea4b1bc2d319 (DEFAULT_TABLE table=default.table_d5638af53ccf40f2b367cf74de29e633 [id=83bafe99e25046a4a43a3739a3ca07a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.287057 24642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a7f651c19e4912a8e0ea4b1bc2d319. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.287177 24918 log.cc:826] T b68f23d363924777ad43e7cbe5981571 P 8668dad23e404dafb0ac25267f07bd46: Log is configured to *not* fsync() on all Append() calls
I20261120 09:03:23.291271 23869 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu
/tmp/dist-test-taskH9EWc6/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.79.126:41659
--webserver_interface=127.23.79.126
--webserver_port=33973
--builtin_ntp_servers=127.23.79.84:36147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881
--hive_metastore_uris=thrift://127.0.0.1:38755
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20261120 09:03:23.297065 24919 tablet_bootstrap.cc:654] T 703a95501e53451ea18439c1651c064d P 2fb9ff0dc3d849d7bcf95806233d2c62: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.298426 24919 log.cc:826] T 703a95501e53451ea18439c1651c064d P 2fb9ff0dc3d849d7bcf95806233d2c62: Log is configured to *not* fsync() on all Append() calls
I20261120 09:03:23.305521 24489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a7f651c19e4912a8e0ea4b1bc2d319. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.320434 24917 sys_catalog.cc:455] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "d82bf27d60fa450e8f941d1a9d36a825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:23.320796 24917 sys_catalog.cc:458] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: This master's current role is: LEADER
I20261120 09:03:23.351013 24318 catalog_manager.cc:2218] created HMS catalog entry for table  [id=315bdedf9fe44e5d866534884f65f6d4]
I20261120 09:03:23.357311 24318 master_service.cc:965] ReplaceTablet: received request to replace tablet b4a7f651c19e4912a8e0ea4b1bc2d319 from {username='slave'} at 127.0.0.1:41728
I20261120 09:03:23.364338 24318 catalog_manager.cc:6151] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: Sending DeleteTablet for 3 replicas of tablet b4a7f651c19e4912a8e0ea4b1bc2d319
I20261120 09:03:23.368088 24318 catalog_manager.cc:6952] ReplaceTablet: tablet b4a7f651c19e4912a8e0ea4b1bc2d319 deleted and replaced by tablet 060080d353484c3a85560b493214e484
I20261120 09:03:23.368510 24318 master_service.cc:965] ReplaceTablet: received request to replace tablet 703a95501e53451ea18439c1651c064d from {username='slave'} at 127.0.0.1:41728
I20261120 09:03:23.369220 24788 tablet_service.cc:1542] Processing DeleteTablet for tablet b4a7f651c19e4912a8e0ea4b1bc2d319 with delete_type TABLET_DATA_DELETED (replaced by tablet 060080d353484c3a85560b493214e484) from {username='slave'} at 127.0.0.1:43956
I20261120 09:03:23.369503 24642 tablet_service.cc:1542] Processing DeleteTablet for tablet b4a7f651c19e4912a8e0ea4b1bc2d319 with delete_type TABLET_DATA_DELETED (replaced by tablet 060080d353484c3a85560b493214e484) from {username='slave'} at 127.0.0.1:40170
I20261120 09:03:23.379750 24789 tablet_service.cc:1495] Processing CreateTablet for tablet 75e156478a8a470ba5f4942cd8e6a89e (DEFAULT_TABLE table=default.table_3fae2942cff544c29c926cc5ed10a06c [id=315bdedf9fe44e5d866534884f65f6d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.380249 24789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75e156478a8a470ba5f4942cd8e6a89e. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.383214 24490 tablet_service.cc:1495] Processing CreateTablet for tablet 75e156478a8a470ba5f4942cd8e6a89e (DEFAULT_TABLE table=default.table_3fae2942cff544c29c926cc5ed10a06c [id=315bdedf9fe44e5d866534884f65f6d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.383626 24490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75e156478a8a470ba5f4942cd8e6a89e. 1 dirs total, 0 dirs full, 0 dirs failed
W20261120 09:03:23.383751 24307 catalog_manager.cc:5061] TS 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): delete failed for tablet b4a7f651c19e4912a8e0ea4b1bc2d319 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4a7f651c19e4912a8e0ea4b1bc2d319 already in progress: creating tablet
I20261120 09:03:23.390225 24642 tablet_service.cc:1495] Processing CreateTablet for tablet 75e156478a8a470ba5f4942cd8e6a89e (DEFAULT_TABLE table=default.table_3fae2942cff544c29c926cc5ed10a06c [id=315bdedf9fe44e5d866534884f65f6d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.390730 24642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75e156478a8a470ba5f4942cd8e6a89e. 1 dirs total, 0 dirs full, 0 dirs failed
W20261120 09:03:23.383406 24305 catalog_manager.cc:5061] TS 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): delete failed for tablet b4a7f651c19e4912a8e0ea4b1bc2d319 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4a7f651c19e4912a8e0ea4b1bc2d319 already in progress: creating tablet
I20261120 09:03:23.400368 24489 tablet_service.cc:1542] Processing DeleteTablet for tablet b4a7f651c19e4912a8e0ea4b1bc2d319 with delete_type TABLET_DATA_DELETED (replaced by tablet 060080d353484c3a85560b493214e484) from {username='slave'} at 127.0.0.1:50044
I20261120 09:03:23.404013 24490 tablet_service.cc:1495] Processing CreateTablet for tablet 060080d353484c3a85560b493214e484 (DEFAULT_TABLE table=default.table_d5638af53ccf40f2b367cf74de29e633 [id=83bafe99e25046a4a43a3739a3ca07a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.404428 24490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 060080d353484c3a85560b493214e484. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.405546 24788 tablet_service.cc:1495] Processing CreateTablet for tablet 060080d353484c3a85560b493214e484 (DEFAULT_TABLE table=default.table_d5638af53ccf40f2b367cf74de29e633 [id=83bafe99e25046a4a43a3739a3ca07a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.406034 24788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 060080d353484c3a85560b493214e484. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.414503 24318 catalog_manager.cc:6151] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: Sending DeleteTablet for 3 replicas of tablet 703a95501e53451ea18439c1651c064d
I20261120 09:03:23.415215 24318 catalog_manager.cc:6952] ReplaceTablet: tablet 703a95501e53451ea18439c1651c064d deleted and replaced by tablet bb6d14de3cb9421987fb9eeb16fbd199
I20261120 09:03:23.415495 24318 master_service.cc:965] ReplaceTablet: received request to replace tablet b68f23d363924777ad43e7cbe5981571 from {username='slave'} at 127.0.0.1:41728
I20261120 09:03:23.416277 24641 tablet_service.cc:1542] Processing DeleteTablet for tablet 703a95501e53451ea18439c1651c064d with delete_type TABLET_DATA_DELETED (replaced by tablet bb6d14de3cb9421987fb9eeb16fbd199) from {username='slave'} at 127.0.0.1:40170
I20261120 09:03:23.416424 24642 tablet_service.cc:1495] Processing CreateTablet for tablet 060080d353484c3a85560b493214e484 (DEFAULT_TABLE table=default.table_d5638af53ccf40f2b367cf74de29e633 [id=83bafe99e25046a4a43a3739a3ca07a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.416626 24490 tablet_service.cc:1542] Processing DeleteTablet for tablet 703a95501e53451ea18439c1651c064d with delete_type TABLET_DATA_DELETED (replaced by tablet bb6d14de3cb9421987fb9eeb16fbd199) from {username='slave'} at 127.0.0.1:50044
I20261120 09:03:23.416895 24642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 060080d353484c3a85560b493214e484. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.416970 24789 tablet_service.cc:1542] Processing DeleteTablet for tablet 703a95501e53451ea18439c1651c064d with delete_type TABLET_DATA_DELETED (replaced by tablet bb6d14de3cb9421987fb9eeb16fbd199) from {username='slave'} at 127.0.0.1:43956
W20261120 09:03:23.418195 24305 catalog_manager.cc:5061] TS 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): delete failed for tablet b4a7f651c19e4912a8e0ea4b1bc2d319 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4a7f651c19e4912a8e0ea4b1bc2d319 already in progress: creating tablet
W20261120 09:03:23.418440 24305 catalog_manager.cc:5061] TS 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): delete failed for tablet 703a95501e53451ea18439c1651c064d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 703a95501e53451ea18439c1651c064d already in progress: creating tablet
W20261120 09:03:23.418952 24307 catalog_manager.cc:5061] TS 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): delete failed for tablet 703a95501e53451ea18439c1651c064d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 703a95501e53451ea18439c1651c064d already in progress: creating tablet
I20261120 09:03:23.423861 24789 tablet_service.cc:1495] Processing CreateTablet for tablet bb6d14de3cb9421987fb9eeb16fbd199 (DEFAULT_TABLE table=default.table_44e6e9d80f3244618eb164246f389566 [id=cb55967ea90e43be8da1354763f7984c]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.424258 24789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb6d14de3cb9421987fb9eeb16fbd199. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.424973 24489 tablet_service.cc:1495] Processing CreateTablet for tablet bb6d14de3cb9421987fb9eeb16fbd199 (DEFAULT_TABLE table=default.table_44e6e9d80f3244618eb164246f389566 [id=cb55967ea90e43be8da1354763f7984c]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.425336 24489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb6d14de3cb9421987fb9eeb16fbd199. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.423833 24641 tablet_service.cc:1495] Processing CreateTablet for tablet bb6d14de3cb9421987fb9eeb16fbd199 (DEFAULT_TABLE table=default.table_44e6e9d80f3244618eb164246f389566 [id=cb55967ea90e43be8da1354763f7984c]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.430068 24641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb6d14de3cb9421987fb9eeb16fbd199. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.438366 24318 catalog_manager.cc:6151] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: Sending DeleteTablet for 3 replicas of tablet b68f23d363924777ad43e7cbe5981571
I20261120 09:03:23.439069 24318 catalog_manager.cc:6952] ReplaceTablet: tablet b68f23d363924777ad43e7cbe5981571 deleted and replaced by tablet fa8252fc6fee4aa7b20b53a08623e358
I20261120 09:03:23.439440 24318 master_service.cc:965] ReplaceTablet: received request to replace tablet b68f23d363924777ad43e7cbe5981571 from {username='slave'} at 127.0.0.1:41728
I20261120 09:03:23.439431 24490 tablet_service.cc:1542] Processing DeleteTablet for tablet b68f23d363924777ad43e7cbe5981571 with delete_type TABLET_DATA_DELETED (replaced by tablet fa8252fc6fee4aa7b20b53a08623e358) from {username='slave'} at 127.0.0.1:50044
I20261120 09:03:23.440006 24318 master_service.cc:965] ReplaceTablet: received request to replace tablet 703a95501e53451ea18439c1651c064d from {username='slave'} at 127.0.0.1:41728
I20261120 09:03:23.440582 24318 catalog_manager.cc:3588] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41728:
table { table_name: "default.Table_3fae2942cff544c29c926cc5ed10a06c" } new_table_name: "default.Table_f9f890b63b384c3b9f30da0ba8a80c03" modify_external_catalogs: true
I20261120 09:03:23.441598 24640 tablet_service.cc:1542] Processing DeleteTablet for tablet b68f23d363924777ad43e7cbe5981571 with delete_type TABLET_DATA_DELETED (replaced by tablet fa8252fc6fee4aa7b20b53a08623e358) from {username='slave'} at 127.0.0.1:40170
I20261120 09:03:23.442898 24789 tablet_service.cc:1542] Processing DeleteTablet for tablet b68f23d363924777ad43e7cbe5981571 with delete_type TABLET_DATA_DELETED (replaced by tablet fa8252fc6fee4aa7b20b53a08623e358) from {username='slave'} at 127.0.0.1:43956
W20261120 09:03:23.443219 24307 catalog_manager.cc:5061] TS 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): delete failed for tablet b68f23d363924777ad43e7cbe5981571 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b68f23d363924777ad43e7cbe5981571 already in progress: creating tablet
W20261120 09:03:23.443481 24305 catalog_manager.cc:5061] TS 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): delete failed for tablet b68f23d363924777ad43e7cbe5981571 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b68f23d363924777ad43e7cbe5981571 already in progress: creating tablet
I20261120 09:03:23.450623 24490 tablet_service.cc:1495] Processing CreateTablet for tablet fa8252fc6fee4aa7b20b53a08623e358 (DEFAULT_TABLE table=default.table_eb77729285254174a498bb17a0adceea [id=90570e46cebe47eba97e5b980f23e909]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.451082 24490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa8252fc6fee4aa7b20b53a08623e358. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.451159 24789 tablet_service.cc:1495] Processing CreateTablet for tablet fa8252fc6fee4aa7b20b53a08623e358 (DEFAULT_TABLE table=default.table_eb77729285254174a498bb17a0adceea [id=90570e46cebe47eba97e5b980f23e909]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.451629 24789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa8252fc6fee4aa7b20b53a08623e358. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.458542 24641 tablet_service.cc:1495] Processing CreateTablet for tablet fa8252fc6fee4aa7b20b53a08623e358 (DEFAULT_TABLE table=default.table_eb77729285254174a498bb17a0adceea [id=90570e46cebe47eba97e5b980f23e909]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.458973 24641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa8252fc6fee4aa7b20b53a08623e358. 1 dirs total, 0 dirs full, 0 dirs failed
W20261120 09:03:23.463228 24305 catalog_manager.cc:5061] TS 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): delete failed for tablet 703a95501e53451ea18439c1651c064d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 703a95501e53451ea18439c1651c064d already in progress: creating tablet
W20261120 09:03:23.463877 24305 catalog_manager.cc:5061] TS 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): delete failed for tablet b68f23d363924777ad43e7cbe5981571 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b68f23d363924777ad43e7cbe5981571 already in progress: creating tablet
I20261120 09:03:23.466493 24920 tablet_bootstrap.cc:492] T b68f23d363924777ad43e7cbe5981571 P 2c3fe57b9d2c424da181281af303f3c3: No bootstrap required, opened a new log
I20261120 09:03:23.466890 24920 ts_tablet_manager.cc:1449] T b68f23d363924777ad43e7cbe5981571 P 2c3fe57b9d2c424da181281af303f3c3: Time spent bootstrapping tablet: real 0.196s	user 0.006s	sys 0.009s
I20261120 09:03:23.477075 24919 tablet_bootstrap.cc:492] T 703a95501e53451ea18439c1651c064d P 2fb9ff0dc3d849d7bcf95806233d2c62: No bootstrap required, opened a new log
I20261120 09:03:23.478858 24919 ts_tablet_manager.cc:1449] T 703a95501e53451ea18439c1651c064d P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent bootstrapping tablet: real 0.205s	user 0.034s	sys 0.059s
I20261120 09:03:23.484613 24918 tablet_bootstrap.cc:492] T b68f23d363924777ad43e7cbe5981571 P 8668dad23e404dafb0ac25267f07bd46: No bootstrap required, opened a new log
I20261120 09:03:23.484980 24918 ts_tablet_manager.cc:1449] T b68f23d363924777ad43e7cbe5981571 P 8668dad23e404dafb0ac25267f07bd46: Time spent bootstrapping tablet: real 0.206s	user 0.045s	sys 0.084s
I20261120 09:03:23.486672 24919 raft_consensus.cc:366] T 703a95501e53451ea18439c1651c064d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } }
I20261120 09:03:23.487185 24919 raft_consensus.cc:392] T 703a95501e53451ea18439c1651c064d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:23.487358 24919 raft_consensus.cc:787] T 703a95501e53451ea18439c1651c064d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Initialized, Role: FOLLOWER
I20261120 09:03:23.488220 24919 consensus_queue.cc:261] T 703a95501e53451ea18439c1651c064d P 2fb9ff0dc3d849d7bcf95806233d2c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } }
I20261120 09:03:23.498653 24317 catalog_manager.cc:2218] created HMS catalog entry for table  [id=aa6cfb171b4c482caa17d7c0862da3d0]
I20261120 09:03:23.500348 24920 raft_consensus.cc:366] T b68f23d363924777ad43e7cbe5981571 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.500862 24920 raft_consensus.cc:392] T b68f23d363924777ad43e7cbe5981571 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:23.501034 24920 raft_consensus.cc:787] T b68f23d363924777ad43e7cbe5981571 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Initialized, Role: FOLLOWER
I20261120 09:03:23.501844 24920 consensus_queue.cc:261] T b68f23d363924777ad43e7cbe5981571 P 2c3fe57b9d2c424da181281af303f3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.505568 24317 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:41728 (request call id 5) took 1026 ms. Trace:
I20261120 09:03:23.505733 24317 rpcz_store.cc:276] 1120 09:03:22.479214 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:22.479264 (+    50us) service_pool.cc:224] Handling call
1120 09:03:23.144209 (+664945us) catalog_manager.cc:2145] Acquired catalog manager lock
1120 09:03:23.144720 (+   511us) catalog_manager.cc:2191] Created new table and tablet info
1120 09:03:23.498601 (+353881us) catalog_manager.cc:2217] Created new table in HMS catalog
1120 09:03:23.505274 (+  6673us) catalog_manager.cc:2251] Wrote table and tablets to system table
1120 09:03:23.505404 (+   130us) catalog_manager.cc:2285] Inserted table and tablets into CatalogManager maps
1120 09:03:23.505522 (+   118us) inbound_call.cc:177] Queueing success response
Related trace 'op':
1120 09:03:23.499572 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1120 09:03:23.499776 (+   204us) write_op.cc:437] Acquiring schema lock in shared mode
1120 09:03:23.499787 (+    11us) write_op.cc:440] Acquired schema lock
1120 09:03:23.499792 (+     5us) tablet.cc:710] Decoding operations
1120 09:03:23.499954 (+   162us) write_op.cc:625] Acquiring the partition lock for write op
1120 09:03:23.499977 (+    23us) write_op.cc:646] Partition lock acquired for write op
1120 09:03:23.499987 (+    10us) tablet.cc:742] Acquiring locks for 2 operations
1120 09:03:23.500113 (+   126us) tablet.cc:758] Row locks acquired
1120 09:03:23.500115 (+     2us) write_op.cc:260] PREPARE: finished
1120 09:03:23.500169 (+    54us) write_op.cc:270] Start()
1120 09:03:23.500211 (+    42us) write_op.cc:276] Timestamp: P: 1795165403500080 usec, L: 0
1120 09:03:23.500215 (+     4us) op_driver.cc:350] REPLICATION: starting
1120 09:03:23.500421 (+   206us) log.cc:844] Serialized 432 byte log entry
1120 09:03:23.504381 (+  3960us) op_driver.cc:466] REPLICATION: finished
1120 09:03:23.504543 (+   162us) write_op.cc:301] APPLY: starting
1120 09:03:23.504561 (+    18us) tablet.cc:1451] starting BulkCheckPresence
1120 09:03:23.504620 (+    59us) tablet.cc:1454] finished BulkCheckPresence
1120 09:03:23.504649 (+    29us) tablet.cc:1456] starting ApplyRowOperation cycle
1120 09:03:23.504932 (+   283us) tablet.cc:1467] finished ApplyRowOperation cycle
1120 09:03:23.504968 (+    36us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
1120 09:03:23.504977 (+     9us) write_op.cc:312] APPLY: finished
1120 09:03:23.505059 (+    82us) log.cc:844] Serialized 28 byte log entry
1120 09:03:23.505126 (+    67us) write_op.cc:494] Releasing partition, row and schema locks
1120 09:03:23.505148 (+    22us) write_op.cc:459] Released schema lock
1120 09:03:23.505155 (+     7us) write_op.cc:346] FINISH: Updating metrics
1120 09:03:23.505250 (+    95us) write_op.cc:494] Releasing partition, row and schema locks
1120 09:03:23.505255 (+     5us) write_op.cc:459] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":205736,"Hive Metastore.run_cpu_time_us":338,"Hive Metastore.run_wall_time_us":147789,"child_traces":[["op",{"apply.queue_time_us":107,"apply.run_cpu_time_us":700,"apply.run_wall_time_us":699,"num_ops":2,"prepare.queue_time_us":66,"prepare.run_cpu_time_us":1002,"prepare.run_wall_time_us":1003,"raft.queue_time_us":1310,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":286,"replication_time_us":4132}]]}
I20261120 09:03:23.507666 24317 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41728:
name: "default.Table_67a0134c1cdf49a49bea9d4b2818b558"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:23.514554 24920 ts_tablet_manager.cc:1480] T b68f23d363924777ad43e7cbe5981571 P 2c3fe57b9d2c424da181281af303f3c3: Time spent starting tablet: real 0.047s	user 0.001s	sys 0.016s
I20261120 09:03:23.517055 24788 tablet_service.cc:1495] Processing CreateTablet for tablet aa0f46d52f9b4608ba87baf575d59f89 (DEFAULT_TABLE table=default.table_4bb4f7811f444da2b0eca6ab9e9203dd [id=aa6cfb171b4c482caa17d7c0862da3d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.517594 24788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0f46d52f9b4608ba87baf575d59f89. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.519455 24920 tablet_bootstrap.cc:492] T 703a95501e53451ea18439c1651c064d P 2c3fe57b9d2c424da181281af303f3c3: Bootstrap starting.
I20261120 09:03:23.521332 24920 tablet_bootstrap.cc:654] T 703a95501e53451ea18439c1651c064d P 2c3fe57b9d2c424da181281af303f3c3: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.522934 24642 tablet_service.cc:1495] Processing CreateTablet for tablet aa0f46d52f9b4608ba87baf575d59f89 (DEFAULT_TABLE table=default.table_4bb4f7811f444da2b0eca6ab9e9203dd [id=aa6cfb171b4c482caa17d7c0862da3d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.523455 24642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0f46d52f9b4608ba87baf575d59f89. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.531296 24489 tablet_service.cc:1495] Processing CreateTablet for tablet aa0f46d52f9b4608ba87baf575d59f89 (DEFAULT_TABLE table=default.table_4bb4f7811f444da2b0eca6ab9e9203dd [id=aa6cfb171b4c482caa17d7c0862da3d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.531771 24489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0f46d52f9b4608ba87baf575d59f89. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.532471 24920 tablet_bootstrap.cc:492] T 703a95501e53451ea18439c1651c064d P 2c3fe57b9d2c424da181281af303f3c3: No bootstrap required, opened a new log
I20261120 09:03:23.532667 24920 ts_tablet_manager.cc:1449] T 703a95501e53451ea18439c1651c064d P 2c3fe57b9d2c424da181281af303f3c3: Time spent bootstrapping tablet: real 0.013s	user 0.003s	sys 0.007s
I20261120 09:03:23.533761 24920 raft_consensus.cc:366] T 703a95501e53451ea18439c1651c064d P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } }
I20261120 09:03:23.534108 24920 raft_consensus.cc:392] T 703a95501e53451ea18439c1651c064d P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:23.534248 24920 raft_consensus.cc:787] T 703a95501e53451ea18439c1651c064d P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Initialized, Role: FOLLOWER
I20261120 09:03:23.534596 24920 consensus_queue.cc:261] T 703a95501e53451ea18439c1651c064d P 2c3fe57b9d2c424da181281af303f3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } }
I20261120 09:03:23.538304 24920 ts_tablet_manager.cc:1480] T 703a95501e53451ea18439c1651c064d P 2c3fe57b9d2c424da181281af303f3c3: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20261120 09:03:23.538918 24918 raft_consensus.cc:366] T b68f23d363924777ad43e7cbe5981571 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.539441 24918 raft_consensus.cc:392] T b68f23d363924777ad43e7cbe5981571 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:23.539583 24918 raft_consensus.cc:787] T b68f23d363924777ad43e7cbe5981571 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Initialized, Role: FOLLOWER
I20261120 09:03:23.540465 24918 consensus_queue.cc:261] T b68f23d363924777ad43e7cbe5981571 P 8668dad23e404dafb0ac25267f07bd46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.541630 24920 tablet_bootstrap.cc:492] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2c3fe57b9d2c424da181281af303f3c3: Bootstrap starting.
I20261120 09:03:23.542496 24919 ts_tablet_manager.cc:1480] T 703a95501e53451ea18439c1651c064d P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent starting tablet: real 0.063s	user 0.013s	sys 0.013s
I20261120 09:03:23.543519 24920 tablet_bootstrap.cc:654] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2c3fe57b9d2c424da181281af303f3c3: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.548038 24919 tablet_bootstrap.cc:492] T b68f23d363924777ad43e7cbe5981571 P 2fb9ff0dc3d849d7bcf95806233d2c62: Bootstrap starting.
I20261120 09:03:23.550019 24919 tablet_bootstrap.cc:654] T b68f23d363924777ad43e7cbe5981571 P 2fb9ff0dc3d849d7bcf95806233d2c62: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.554100 24920 tablet_bootstrap.cc:492] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2c3fe57b9d2c424da181281af303f3c3: No bootstrap required, opened a new log
I20261120 09:03:23.554319 24920 ts_tablet_manager.cc:1449] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2c3fe57b9d2c424da181281af303f3c3: Time spent bootstrapping tablet: real 0.013s	user 0.001s	sys 0.006s
I20261120 09:03:23.555213 24920 raft_consensus.cc:366] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.555496 24920 raft_consensus.cc:392] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20261120 09:03:23.555644 24578 tablet.cc:2554] T 703a95501e53451ea18439c1651c064d P 2c3fe57b9d2c424da181281af303f3c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20261120 09:03:23.556185 24918 ts_tablet_manager.cc:1480] T b68f23d363924777ad43e7cbe5981571 P 8668dad23e404dafb0ac25267f07bd46: Time spent starting tablet: real 0.071s	user 0.012s	sys 0.001s
I20261120 09:03:23.555635 24920 raft_consensus.cc:787] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Initialized, Role: FOLLOWER
I20261120 09:03:23.556982 24920 consensus_queue.cc:261] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2c3fe57b9d2c424da181281af303f3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.557735 24918 tablet_bootstrap.cc:492] T 703a95501e53451ea18439c1651c064d P 8668dad23e404dafb0ac25267f07bd46: Bootstrap starting.
I20261120 09:03:23.560122 24918 tablet_bootstrap.cc:654] T 703a95501e53451ea18439c1651c064d P 8668dad23e404dafb0ac25267f07bd46: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.561589 24920 ts_tablet_manager.cc:1480] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2c3fe57b9d2c424da181281af303f3c3: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.002s
I20261120 09:03:23.564677 24920 tablet_bootstrap.cc:492] T 75e156478a8a470ba5f4942cd8e6a89e P 2c3fe57b9d2c424da181281af303f3c3: Bootstrap starting.
I20261120 09:03:23.566432 24920 tablet_bootstrap.cc:654] T 75e156478a8a470ba5f4942cd8e6a89e P 2c3fe57b9d2c424da181281af303f3c3: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.568626 24919 tablet_bootstrap.cc:492] T b68f23d363924777ad43e7cbe5981571 P 2fb9ff0dc3d849d7bcf95806233d2c62: No bootstrap required, opened a new log
I20261120 09:03:23.568847 24919 ts_tablet_manager.cc:1449] T b68f23d363924777ad43e7cbe5981571 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.006s
I20261120 09:03:23.569895 24919 raft_consensus.cc:366] T b68f23d363924777ad43e7cbe5981571 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.570183 24919 raft_consensus.cc:392] T b68f23d363924777ad43e7cbe5981571 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:23.570325 24919 raft_consensus.cc:787] T b68f23d363924777ad43e7cbe5981571 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Initialized, Role: FOLLOWER
I20261120 09:03:23.570683 24919 consensus_queue.cc:261] T b68f23d363924777ad43e7cbe5981571 P 2fb9ff0dc3d849d7bcf95806233d2c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.571273 24919 ts_tablet_manager.cc:1480] T b68f23d363924777ad43e7cbe5981571 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.001s
I20261120 09:03:23.571538 24919 tablet_bootstrap.cc:492] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2fb9ff0dc3d849d7bcf95806233d2c62: Bootstrap starting.
I20261120 09:03:23.571898 24920 tablet_bootstrap.cc:492] T 75e156478a8a470ba5f4942cd8e6a89e P 2c3fe57b9d2c424da181281af303f3c3: No bootstrap required, opened a new log
I20261120 09:03:23.572053 24920 ts_tablet_manager.cc:1449] T 75e156478a8a470ba5f4942cd8e6a89e P 2c3fe57b9d2c424da181281af303f3c3: Time spent bootstrapping tablet: real 0.007s	user 0.000s	sys 0.006s
I20261120 09:03:23.573032 24920 raft_consensus.cc:366] T 75e156478a8a470ba5f4942cd8e6a89e P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.573179 24919 tablet_bootstrap.cc:654] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2fb9ff0dc3d849d7bcf95806233d2c62: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.573232 24920 raft_consensus.cc:392] T 75e156478a8a470ba5f4942cd8e6a89e P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:23.573385 24920 raft_consensus.cc:787] T 75e156478a8a470ba5f4942cd8e6a89e P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Initialized, Role: FOLLOWER
I20261120 09:03:23.573661 24920 consensus_queue.cc:261] T 75e156478a8a470ba5f4942cd8e6a89e P 2c3fe57b9d2c424da181281af303f3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.576965 24920 ts_tablet_manager.cc:1480] T 75e156478a8a470ba5f4942cd8e6a89e P 2c3fe57b9d2c424da181281af303f3c3: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.001s
I20261120 09:03:23.579922 24920 tablet_bootstrap.cc:492] T 060080d353484c3a85560b493214e484 P 2c3fe57b9d2c424da181281af303f3c3: Bootstrap starting.
I20261120 09:03:23.581290 24919 tablet_bootstrap.cc:492] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2fb9ff0dc3d849d7bcf95806233d2c62: No bootstrap required, opened a new log
I20261120 09:03:23.581506 24919 ts_tablet_manager.cc:1449] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent bootstrapping tablet: real 0.010s	user 0.001s	sys 0.008s
I20261120 09:03:23.581529 24920 tablet_bootstrap.cc:654] T 060080d353484c3a85560b493214e484 P 2c3fe57b9d2c424da181281af303f3c3: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.582343 24919 raft_consensus.cc:366] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.582636 24919 raft_consensus.cc:392] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:23.582777 24919 raft_consensus.cc:787] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Initialized, Role: FOLLOWER
I20261120 09:03:23.583119 24919 consensus_queue.cc:261] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2fb9ff0dc3d849d7bcf95806233d2c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.584666 24920 tablet_bootstrap.cc:492] T 060080d353484c3a85560b493214e484 P 2c3fe57b9d2c424da181281af303f3c3: No bootstrap required, opened a new log
I20261120 09:03:23.584841 24920 ts_tablet_manager.cc:1449] T 060080d353484c3a85560b493214e484 P 2c3fe57b9d2c424da181281af303f3c3: Time spent bootstrapping tablet: real 0.005s	user 0.000s	sys 0.004s
I20261120 09:03:23.585496 24919 ts_tablet_manager.cc:1480] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.001s
I20261120 09:03:23.585462 24920 raft_consensus.cc:366] T 060080d353484c3a85560b493214e484 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.585700 24920 raft_consensus.cc:392] T 060080d353484c3a85560b493214e484 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:23.585774 24920 raft_consensus.cc:787] T 060080d353484c3a85560b493214e484 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Initialized, Role: FOLLOWER
I20261120 09:03:23.586015 24920 consensus_queue.cc:261] T 060080d353484c3a85560b493214e484 P 2c3fe57b9d2c424da181281af303f3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.587646 24919 tablet_bootstrap.cc:492] T 75e156478a8a470ba5f4942cd8e6a89e P 2fb9ff0dc3d849d7bcf95806233d2c62: Bootstrap starting.
I20261120 09:03:23.589140 24920 ts_tablet_manager.cc:1480] T 060080d353484c3a85560b493214e484 P 2c3fe57b9d2c424da181281af303f3c3: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.002s
I20261120 09:03:23.589327 24919 tablet_bootstrap.cc:654] T 75e156478a8a470ba5f4942cd8e6a89e P 2fb9ff0dc3d849d7bcf95806233d2c62: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.591950 24920 tablet_bootstrap.cc:492] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3: Bootstrap starting.
I20261120 09:03:23.593482 24920 tablet_bootstrap.cc:654] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.595594 24918 tablet_bootstrap.cc:492] T 703a95501e53451ea18439c1651c064d P 8668dad23e404dafb0ac25267f07bd46: No bootstrap required, opened a new log
I20261120 09:03:23.595777 24918 ts_tablet_manager.cc:1449] T 703a95501e53451ea18439c1651c064d P 8668dad23e404dafb0ac25267f07bd46: Time spent bootstrapping tablet: real 0.038s	user 0.004s	sys 0.001s
I20261120 09:03:23.596711 24920 tablet_bootstrap.cc:492] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3: No bootstrap required, opened a new log
I20261120 09:03:23.596832 24920 ts_tablet_manager.cc:1449] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3: Time spent bootstrapping tablet: real 0.005s	user 0.000s	sys 0.004s
I20261120 09:03:23.596902 24918 raft_consensus.cc:366] T 703a95501e53451ea18439c1651c064d P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } }
I20261120 09:03:23.597096 24918 raft_consensus.cc:392] T 703a95501e53451ea18439c1651c064d P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:23.597195 24918 raft_consensus.cc:787] T 703a95501e53451ea18439c1651c064d P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Initialized, Role: FOLLOWER
I20261120 09:03:23.597440 24920 raft_consensus.cc:366] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.597589 24920 raft_consensus.cc:392] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:23.597560 24918 consensus_queue.cc:261] T 703a95501e53451ea18439c1651c064d P 8668dad23e404dafb0ac25267f07bd46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } }
I20261120 09:03:23.597694 24920 raft_consensus.cc:787] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Initialized, Role: FOLLOWER
I20261120 09:03:23.597918 24920 consensus_queue.cc:261] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.598187 24918 ts_tablet_manager.cc:1480] T 703a95501e53451ea18439c1651c064d P 8668dad23e404dafb0ac25267f07bd46: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.001s
I20261120 09:03:23.598575 24918 tablet_bootstrap.cc:492] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 8668dad23e404dafb0ac25267f07bd46: Bootstrap starting.
I20261120 09:03:23.600871 24918 tablet_bootstrap.cc:654] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 8668dad23e404dafb0ac25267f07bd46: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.601061 24920 ts_tablet_manager.cc:1480] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.001s
I20261120 09:03:23.603739 24920 tablet_bootstrap.cc:492] T bb6d14de3cb9421987fb9eeb16fbd199 P 2c3fe57b9d2c424da181281af303f3c3: Bootstrap starting.
I20261120 09:03:23.605450 24920 tablet_bootstrap.cc:654] T bb6d14de3cb9421987fb9eeb16fbd199 P 2c3fe57b9d2c424da181281af303f3c3: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.605993 24919 tablet_bootstrap.cc:492] T 75e156478a8a470ba5f4942cd8e6a89e P 2fb9ff0dc3d849d7bcf95806233d2c62: No bootstrap required, opened a new log
I20261120 09:03:23.606204 24919 ts_tablet_manager.cc:1449] T 75e156478a8a470ba5f4942cd8e6a89e P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent bootstrapping tablet: real 0.019s	user 0.001s	sys 0.016s
I20261120 09:03:23.607050 24919 raft_consensus.cc:366] T 75e156478a8a470ba5f4942cd8e6a89e P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.607309 24919 raft_consensus.cc:392] T 75e156478a8a470ba5f4942cd8e6a89e P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:23.607434 24919 raft_consensus.cc:787] T 75e156478a8a470ba5f4942cd8e6a89e P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Initialized, Role: FOLLOWER
I20261120 09:03:23.607749 24918 tablet_bootstrap.cc:492] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 8668dad23e404dafb0ac25267f07bd46: No bootstrap required, opened a new log
I20261120 09:03:23.607683 24919 consensus_queue.cc:261] T 75e156478a8a470ba5f4942cd8e6a89e P 2fb9ff0dc3d849d7bcf95806233d2c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.607897 24918 ts_tablet_manager.cc:1449] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 8668dad23e404dafb0ac25267f07bd46: Time spent bootstrapping tablet: real 0.009s	user 0.004s	sys 0.000s
I20261120 09:03:23.608556 24918 raft_consensus.cc:366] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.608682 24920 tablet_bootstrap.cc:492] T bb6d14de3cb9421987fb9eeb16fbd199 P 2c3fe57b9d2c424da181281af303f3c3: No bootstrap required, opened a new log
I20261120 09:03:23.608736 24918 raft_consensus.cc:392] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:23.608809 24918 raft_consensus.cc:787] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Initialized, Role: FOLLOWER
I20261120 09:03:23.608831 24920 ts_tablet_manager.cc:1449] T bb6d14de3cb9421987fb9eeb16fbd199 P 2c3fe57b9d2c424da181281af303f3c3: Time spent bootstrapping tablet: real 0.005s	user 0.001s	sys 0.003s
I20261120 09:03:23.609089 24918 consensus_queue.cc:261] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 8668dad23e404dafb0ac25267f07bd46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.609529 24918 ts_tablet_manager.cc:1480] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 8668dad23e404dafb0ac25267f07bd46: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.001s
I20261120 09:03:23.609573 24920 raft_consensus.cc:366] T bb6d14de3cb9421987fb9eeb16fbd199 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.609771 24920 raft_consensus.cc:392] T bb6d14de3cb9421987fb9eeb16fbd199 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:23.609830 24918 tablet_bootstrap.cc:492] T 75e156478a8a470ba5f4942cd8e6a89e P 8668dad23e404dafb0ac25267f07bd46: Bootstrap starting.
I20261120 09:03:23.609840 24920 raft_consensus.cc:787] T bb6d14de3cb9421987fb9eeb16fbd199 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Initialized, Role: FOLLOWER
I20261120 09:03:23.610090 24920 consensus_queue.cc:261] T bb6d14de3cb9421987fb9eeb16fbd199 P 2c3fe57b9d2c424da181281af303f3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.610463 24919 ts_tablet_manager.cc:1480] T 75e156478a8a470ba5f4942cd8e6a89e P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
I20261120 09:03:23.611474 24918 tablet_bootstrap.cc:654] T 75e156478a8a470ba5f4942cd8e6a89e P 8668dad23e404dafb0ac25267f07bd46: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.612735 24919 tablet_bootstrap.cc:492] T bb6d14de3cb9421987fb9eeb16fbd199 P 2fb9ff0dc3d849d7bcf95806233d2c62: Bootstrap starting.
I20261120 09:03:23.613607 24920 ts_tablet_manager.cc:1480] T bb6d14de3cb9421987fb9eeb16fbd199 P 2c3fe57b9d2c424da181281af303f3c3: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.002s
I20261120 09:03:23.614553 24919 tablet_bootstrap.cc:654] T bb6d14de3cb9421987fb9eeb16fbd199 P 2fb9ff0dc3d849d7bcf95806233d2c62: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.616526 24920 tablet_bootstrap.cc:492] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3: Bootstrap starting.
I20261120 09:03:23.618342 24920 tablet_bootstrap.cc:654] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.622411 24919 tablet_bootstrap.cc:492] T bb6d14de3cb9421987fb9eeb16fbd199 P 2fb9ff0dc3d849d7bcf95806233d2c62: No bootstrap required, opened a new log
I20261120 09:03:23.622646 24919 ts_tablet_manager.cc:1449] T bb6d14de3cb9421987fb9eeb16fbd199 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.001s
I20261120 09:03:23.623335 24918 tablet_bootstrap.cc:492] T 75e156478a8a470ba5f4942cd8e6a89e P 8668dad23e404dafb0ac25267f07bd46: No bootstrap required, opened a new log
I20261120 09:03:23.623479 24918 ts_tablet_manager.cc:1449] T 75e156478a8a470ba5f4942cd8e6a89e P 8668dad23e404dafb0ac25267f07bd46: Time spent bootstrapping tablet: real 0.014s	user 0.000s	sys 0.003s
I20261120 09:03:23.623458 24919 raft_consensus.cc:366] T bb6d14de3cb9421987fb9eeb16fbd199 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.623765 24919 raft_consensus.cc:392] T bb6d14de3cb9421987fb9eeb16fbd199 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:23.624065 24919 raft_consensus.cc:787] T bb6d14de3cb9421987fb9eeb16fbd199 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Initialized, Role: FOLLOWER
I20261120 09:03:23.624194 24918 raft_consensus.cc:366] T 75e156478a8a470ba5f4942cd8e6a89e P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.624367 24918 raft_consensus.cc:392] T 75e156478a8a470ba5f4942cd8e6a89e P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:23.624450 24918 raft_consensus.cc:787] T 75e156478a8a470ba5f4942cd8e6a89e P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Initialized, Role: FOLLOWER
I20261120 09:03:23.624500 24919 consensus_queue.cc:261] T bb6d14de3cb9421987fb9eeb16fbd199 P 2fb9ff0dc3d849d7bcf95806233d2c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.626819 24920 tablet_bootstrap.cc:492] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3: No bootstrap required, opened a new log
I20261120 09:03:23.626959 24920 ts_tablet_manager.cc:1449] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3: Time spent bootstrapping tablet: real 0.011s	user 0.005s	sys 0.005s
I20261120 09:03:23.627643 24919 ts_tablet_manager.cc:1480] T bb6d14de3cb9421987fb9eeb16fbd199 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.000s
I20261120 09:03:23.627736 24920 raft_consensus.cc:366] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.627914 24920 raft_consensus.cc:392] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:23.628005 24920 raft_consensus.cc:787] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Initialized, Role: FOLLOWER
I20261120 09:03:23.628178 24918 consensus_queue.cc:261] T 75e156478a8a470ba5f4942cd8e6a89e P 8668dad23e404dafb0ac25267f07bd46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.628283 24920 consensus_queue.cc:261] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.628669 24918 ts_tablet_manager.cc:1480] T 75e156478a8a470ba5f4942cd8e6a89e P 8668dad23e404dafb0ac25267f07bd46: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.001s
I20261120 09:03:23.628983 24918 tablet_bootstrap.cc:492] T bb6d14de3cb9421987fb9eeb16fbd199 P 8668dad23e404dafb0ac25267f07bd46: Bootstrap starting.
I20261120 09:03:23.630242 24919 tablet_bootstrap.cc:492] T fa8252fc6fee4aa7b20b53a08623e358 P 2fb9ff0dc3d849d7bcf95806233d2c62: Bootstrap starting.
I20261120 09:03:23.630708 24918 tablet_bootstrap.cc:654] T bb6d14de3cb9421987fb9eeb16fbd199 P 8668dad23e404dafb0ac25267f07bd46: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.632043 24919 tablet_bootstrap.cc:654] T fa8252fc6fee4aa7b20b53a08623e358 P 2fb9ff0dc3d849d7bcf95806233d2c62: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.633286 24920 ts_tablet_manager.cc:1480] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20261120 09:03:23.640045 24918 tablet_bootstrap.cc:492] T bb6d14de3cb9421987fb9eeb16fbd199 P 8668dad23e404dafb0ac25267f07bd46: No bootstrap required, opened a new log
I20261120 09:03:23.640250 24918 ts_tablet_manager.cc:1449] T bb6d14de3cb9421987fb9eeb16fbd199 P 8668dad23e404dafb0ac25267f07bd46: Time spent bootstrapping tablet: real 0.011s	user 0.000s	sys 0.003s
I20261120 09:03:23.641222 24918 raft_consensus.cc:366] T bb6d14de3cb9421987fb9eeb16fbd199 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.641476 24918 raft_consensus.cc:392] T bb6d14de3cb9421987fb9eeb16fbd199 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:23.641553 24918 raft_consensus.cc:787] T bb6d14de3cb9421987fb9eeb16fbd199 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Initialized, Role: FOLLOWER
I20261120 09:03:23.641839 24918 consensus_queue.cc:261] T bb6d14de3cb9421987fb9eeb16fbd199 P 8668dad23e404dafb0ac25267f07bd46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.643883 24918 ts_tablet_manager.cc:1480] T bb6d14de3cb9421987fb9eeb16fbd199 P 8668dad23e404dafb0ac25267f07bd46: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.002s
I20261120 09:03:23.644238 24918 tablet_bootstrap.cc:492] T fa8252fc6fee4aa7b20b53a08623e358 P 8668dad23e404dafb0ac25267f07bd46: Bootstrap starting.
I20261120 09:03:23.646610 24918 tablet_bootstrap.cc:654] T fa8252fc6fee4aa7b20b53a08623e358 P 8668dad23e404dafb0ac25267f07bd46: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.656888 24919 tablet_bootstrap.cc:492] T fa8252fc6fee4aa7b20b53a08623e358 P 2fb9ff0dc3d849d7bcf95806233d2c62: No bootstrap required, opened a new log
I20261120 09:03:23.657137 24919 ts_tablet_manager.cc:1449] T fa8252fc6fee4aa7b20b53a08623e358 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.010s
I20261120 09:03:23.657557 24316 catalog_manager.cc:2218] created HMS catalog entry for table  [id=f94e62db1de54fcf92c9c893f1a073cf]
I20261120 09:03:23.658087 24919 raft_consensus.cc:366] T fa8252fc6fee4aa7b20b53a08623e358 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
W20261120 09:03:23.658262 24857 tablet.cc:2554] T 703a95501e53451ea18439c1651c064d P 8668dad23e404dafb0ac25267f07bd46: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20261120 09:03:23.658381 24918 tablet_bootstrap.cc:492] T fa8252fc6fee4aa7b20b53a08623e358 P 8668dad23e404dafb0ac25267f07bd46: No bootstrap required, opened a new log
I20261120 09:03:23.658561 24918 ts_tablet_manager.cc:1449] T fa8252fc6fee4aa7b20b53a08623e358 P 8668dad23e404dafb0ac25267f07bd46: Time spent bootstrapping tablet: real 0.014s	user 0.000s	sys 0.004s
I20261120 09:03:23.661924 24918 raft_consensus.cc:366] T fa8252fc6fee4aa7b20b53a08623e358 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.662099 24918 raft_consensus.cc:392] T fa8252fc6fee4aa7b20b53a08623e358 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:23.662199 24918 raft_consensus.cc:787] T fa8252fc6fee4aa7b20b53a08623e358 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Initialized, Role: FOLLOWER
I20261120 09:03:23.664089 24316 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:41728 (request call id 6) took 1183 ms. Trace:
I20261120 09:03:23.664237 24316 rpcz_store.cc:276] 1120 09:03:22.480572 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:22.480637 (+    65us) service_pool.cc:224] Handling call
1120 09:03:23.145452 (+664815us) catalog_manager.cc:2145] Acquired catalog manager lock
1120 09:03:23.145997 (+   545us) catalog_manager.cc:2191] Created new table and tablet info
1120 09:03:23.657499 (+511502us) catalog_manager.cc:2217] Created new table in HMS catalog
1120 09:03:23.663724 (+  6225us) catalog_manager.cc:2251] Wrote table and tablets to system table
1120 09:03:23.663892 (+   168us) catalog_manager.cc:2285] Inserted table and tablets into CatalogManager maps
1120 09:03:23.664035 (+   143us) inbound_call.cc:177] Queueing success response
Related trace 'op':
1120 09:03:23.658500 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1120 09:03:23.658712 (+   212us) write_op.cc:437] Acquiring schema lock in shared mode
1120 09:03:23.658719 (+     7us) write_op.cc:440] Acquired schema lock
1120 09:03:23.658721 (+     2us) tablet.cc:710] Decoding operations
1120 09:03:23.658839 (+   118us) write_op.cc:625] Acquiring the partition lock for write op
1120 09:03:23.658854 (+    15us) write_op.cc:646] Partition lock acquired for write op
1120 09:03:23.658859 (+     5us) tablet.cc:742] Acquiring locks for 2 operations
1120 09:03:23.658944 (+    85us) tablet.cc:758] Row locks acquired
1120 09:03:23.658947 (+     3us) write_op.cc:260] PREPARE: finished
1120 09:03:23.658983 (+    36us) write_op.cc:270] Start()
1120 09:03:23.659017 (+    34us) write_op.cc:276] Timestamp: P: 1795165403658963 usec, L: 0
1120 09:03:23.659020 (+     3us) op_driver.cc:350] REPLICATION: starting
1120 09:03:23.659209 (+   189us) log.cc:844] Serialized 432 byte log entry
1120 09:03:23.663074 (+  3865us) op_driver.cc:466] REPLICATION: finished
1120 09:03:23.663227 (+   153us) write_op.cc:301] APPLY: starting
1120 09:03:23.663244 (+    17us) tablet.cc:1451] starting BulkCheckPresence
1120 09:03:23.663286 (+    42us) tablet.cc:1454] finished BulkCheckPresence
1120 09:03:23.663309 (+    23us) tablet.cc:1456] starting ApplyRowOperation cycle
1120 09:03:23.663409 (+   100us) tablet.cc:1467] finished ApplyRowOperation cycle
1120 09:03:23.663442 (+    33us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
1120 09:03:23.663450 (+     8us) write_op.cc:312] APPLY: finished
1120 09:03:23.663524 (+    74us) log.cc:844] Serialized 28 byte log entry
1120 09:03:23.663582 (+    58us) write_op.cc:494] Releasing partition, row and schema locks
1120 09:03:23.663604 (+    22us) write_op.cc:459] Released schema lock
1120 09:03:23.663610 (+     6us) write_op.cc:346] FINISH: Updating metrics
1120 09:03:23.663681 (+    71us) write_op.cc:494] Releasing partition, row and schema locks
1120 09:03:23.663684 (+     3us) write_op.cc:459] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":352312,"Hive Metastore.run_cpu_time_us":358,"Hive Metastore.run_wall_time_us":158741,"child_traces":[["op",{"apply.queue_time_us":107,"apply.run_cpu_time_us":448,"apply.run_wall_time_us":448,"num_ops":2,"prepare.queue_time_us":72,"prepare.run_cpu_time_us":832,"prepare.run_wall_time_us":832,"raft.queue_time_us":1393,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":303,"replication_time_us":4013}]]}
I20261120 09:03:23.662487 24918 consensus_queue.cc:261] T fa8252fc6fee4aa7b20b53a08623e358 P 8668dad23e404dafb0ac25267f07bd46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.668258 24489 tablet_service.cc:1542] Processing DeleteTablet for tablet b68f23d363924777ad43e7cbe5981571 with delete_type TABLET_DATA_DELETED (replaced by tablet fa8252fc6fee4aa7b20b53a08623e358) from {username='slave'} at 127.0.0.1:50044
I20261120 09:03:23.669447 24930 tablet_replica.cc:333] T b68f23d363924777ad43e7cbe5981571 P 2c3fe57b9d2c424da181281af303f3c3: stopping tablet replica
I20261120 09:03:23.669941 24930 raft_consensus.cc:2440] T b68f23d363924777ad43e7cbe5981571 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20261120 09:03:23.670202 24919 raft_consensus.cc:392] T fa8252fc6fee4aa7b20b53a08623e358 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:23.670373 24930 raft_consensus.cc:2469] T b68f23d363924777ad43e7cbe5981571 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20261120 09:03:23.670394 24919 raft_consensus.cc:787] T fa8252fc6fee4aa7b20b53a08623e358 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Initialized, Role: FOLLOWER
I20261120 09:03:23.670819 24919 consensus_queue.cc:261] T fa8252fc6fee4aa7b20b53a08623e358 P 2fb9ff0dc3d849d7bcf95806233d2c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
W20261120 09:03:23.673358 24710 tablet.cc:2554] T 703a95501e53451ea18439c1651c064d P 2fb9ff0dc3d849d7bcf95806233d2c62: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20261120 09:03:23.673882 24642 tablet_service.cc:1542] Processing DeleteTablet for tablet 703a95501e53451ea18439c1651c064d with delete_type TABLET_DATA_DELETED (replaced by tablet bb6d14de3cb9421987fb9eeb16fbd199) from {username='slave'} at 127.0.0.1:40170
I20261120 09:03:23.674165 24929 tablet_replica.cc:333] T 703a95501e53451ea18439c1651c064d P 2fb9ff0dc3d849d7bcf95806233d2c62: stopping tablet replica
I20261120 09:03:23.674453 24930 ts_tablet_manager.cc:1962] T b68f23d363924777ad43e7cbe5981571 P 2c3fe57b9d2c424da181281af303f3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261120 09:03:23.674657 24929 raft_consensus.cc:2440] T 703a95501e53451ea18439c1651c064d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Raft consensus shutting down.
I20261120 09:03:23.675031 24929 raft_consensus.cc:2469] T 703a95501e53451ea18439c1651c064d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Raft consensus is shut down!
I20261120 09:03:23.675966 24788 tablet_service.cc:1542] Processing DeleteTablet for tablet b68f23d363924777ad43e7cbe5981571 with delete_type TABLET_DATA_DELETED (replaced by tablet fa8252fc6fee4aa7b20b53a08623e358) from {username='slave'} at 127.0.0.1:43956
I20261120 09:03:23.676323 24928 tablet_replica.cc:333] T b68f23d363924777ad43e7cbe5981571 P 8668dad23e404dafb0ac25267f07bd46: stopping tablet replica
I20261120 09:03:23.676728 24928 raft_consensus.cc:2440] T b68f23d363924777ad43e7cbe5981571 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Raft consensus shutting down.
I20261120 09:03:23.677090 24928 raft_consensus.cc:2469] T b68f23d363924777ad43e7cbe5981571 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Raft consensus is shut down!
I20261120 09:03:23.678898 24929 ts_tablet_manager.cc:1962] T 703a95501e53451ea18439c1651c064d P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261120 09:03:23.683751 24928 ts_tablet_manager.cc:1962] T b68f23d363924777ad43e7cbe5981571 P 8668dad23e404dafb0ac25267f07bd46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261120 09:03:23.693276 24930 ts_tablet_manager.cc:1975] T b68f23d363924777ad43e7cbe5981571 P 2c3fe57b9d2c424da181281af303f3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20261120 09:03:23.693467 24930 log.cc:1199] T b68f23d363924777ad43e7cbe5981571 P 2c3fe57b9d2c424da181281af303f3c3: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-0/wal/wals/b68f23d363924777ad43e7cbe5981571
I20261120 09:03:23.693869 24930 ts_tablet_manager.cc:1996] T b68f23d363924777ad43e7cbe5981571 P 2c3fe57b9d2c424da181281af303f3c3: Deleting consensus metadata
I20261120 09:03:23.695572 24918 ts_tablet_manager.cc:1480] T fa8252fc6fee4aa7b20b53a08623e358 P 8668dad23e404dafb0ac25267f07bd46: Time spent starting tablet: real 0.037s	user 0.002s	sys 0.000s
I20261120 09:03:23.697745 24490 tablet_service.cc:1542] Processing DeleteTablet for tablet 703a95501e53451ea18439c1651c064d with delete_type TABLET_DATA_DELETED (replaced by tablet bb6d14de3cb9421987fb9eeb16fbd199) from {username='slave'} at 127.0.0.1:50044
I20261120 09:03:23.698591 24489 tablet_service.cc:1495] Processing CreateTablet for tablet a8cf83af75c745dc96cb98f99cd2335d (DEFAULT_TABLE table=default.table_c97aaa8fd7f446ed8008a6bcecc8b494 [id=f94e62db1de54fcf92c9c893f1a073cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.699055 24489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8cf83af75c745dc96cb98f99cd2335d. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.702793 24488 tablet_service.cc:1542] Processing DeleteTablet for tablet b4a7f651c19e4912a8e0ea4b1bc2d319 with delete_type TABLET_DATA_DELETED (replaced by tablet 060080d353484c3a85560b493214e484) from {username='slave'} at 127.0.0.1:50044
I20261120 09:03:23.703715 24788 tablet_service.cc:1495] Processing CreateTablet for tablet a8cf83af75c745dc96cb98f99cd2335d (DEFAULT_TABLE table=default.table_c97aaa8fd7f446ed8008a6bcecc8b494 [id=f94e62db1de54fcf92c9c893f1a073cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.704188 24788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8cf83af75c745dc96cb98f99cd2335d. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.704228 24315 catalog_manager.cc:2218] created HMS catalog entry for table  [id=9d133f08f71d42b89628f2869cbaa424]
I20261120 09:03:23.705631 24918 tablet_bootstrap.cc:492] T 060080d353484c3a85560b493214e484 P 8668dad23e404dafb0ac25267f07bd46: Bootstrap starting.
I20261120 09:03:23.707544 24642 tablet_service.cc:1495] Processing CreateTablet for tablet a8cf83af75c745dc96cb98f99cd2335d (DEFAULT_TABLE table=default.table_c97aaa8fd7f446ed8008a6bcecc8b494 [id=f94e62db1de54fcf92c9c893f1a073cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.712056 24918 tablet_bootstrap.cc:654] T 060080d353484c3a85560b493214e484 P 8668dad23e404dafb0ac25267f07bd46: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.714677 24305 catalog_manager.cc:5081] TS 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): tablet b68f23d363924777ad43e7cbe5981571 (table default.table_eb77729285254174a498bb17a0adceea [id=90570e46cebe47eba97e5b980f23e909]) successfully deleted
I20261120 09:03:23.717471 24641 tablet_service.cc:1542] Processing DeleteTablet for tablet b68f23d363924777ad43e7cbe5981571 with delete_type TABLET_DATA_DELETED (replaced by tablet fa8252fc6fee4aa7b20b53a08623e358) from {username='slave'} at 127.0.0.1:40170
I20261120 09:03:23.718466 24641 tablet_service.cc:1542] Processing DeleteTablet for tablet b4a7f651c19e4912a8e0ea4b1bc2d319 with delete_type TABLET_DATA_DELETED (replaced by tablet 060080d353484c3a85560b493214e484) from {username='slave'} at 127.0.0.1:40170
I20261120 09:03:23.721517 24930 tablet_replica.cc:333] T 703a95501e53451ea18439c1651c064d P 2c3fe57b9d2c424da181281af303f3c3: stopping tablet replica
I20261120 09:03:23.721789 24930 raft_consensus.cc:2440] T 703a95501e53451ea18439c1651c064d P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20261120 09:03:23.721985 24930 raft_consensus.cc:2469] T 703a95501e53451ea18439c1651c064d P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20261120 09:03:23.726198 24315 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:41728 (request call id 7) took 1245 ms. Trace:
I20261120 09:03:23.726322 24315 rpcz_store.cc:276] 1120 09:03:22.480754 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:22.480824 (+    70us) service_pool.cc:224] Handling call
1120 09:03:23.146672 (+665848us) catalog_manager.cc:2145] Acquired catalog manager lock
1120 09:03:23.147183 (+   511us) catalog_manager.cc:2191] Created new table and tablet info
1120 09:03:23.704166 (+556983us) catalog_manager.cc:2217] Created new table in HMS catalog
1120 09:03:23.725913 (+ 21747us) catalog_manager.cc:2251] Wrote table and tablets to system table
1120 09:03:23.726049 (+   136us) catalog_manager.cc:2285] Inserted table and tablets into CatalogManager maps
1120 09:03:23.726155 (+   106us) inbound_call.cc:177] Queueing success response
Related trace 'op':
1120 09:03:23.708093 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1120 09:03:23.708241 (+   148us) write_op.cc:437] Acquiring schema lock in shared mode
1120 09:03:23.708250 (+     9us) write_op.cc:440] Acquired schema lock
1120 09:03:23.708253 (+     3us) tablet.cc:710] Decoding operations
1120 09:03:23.708373 (+   120us) write_op.cc:625] Acquiring the partition lock for write op
1120 09:03:23.708392 (+    19us) write_op.cc:646] Partition lock acquired for write op
1120 09:03:23.708398 (+     6us) tablet.cc:742] Acquiring locks for 2 operations
1120 09:03:23.708499 (+   101us) tablet.cc:758] Row locks acquired
1120 09:03:23.708504 (+     5us) write_op.cc:260] PREPARE: finished
1120 09:03:23.708557 (+    53us) write_op.cc:270] Start()
1120 09:03:23.708615 (+    58us) write_op.cc:276] Timestamp: P: 1795165403708523 usec, L: 0
1120 09:03:23.708619 (+     4us) op_driver.cc:350] REPLICATION: starting
1120 09:03:23.708842 (+   223us) log.cc:844] Serialized 432 byte log entry
1120 09:03:23.725165 (+ 16323us) op_driver.cc:466] REPLICATION: finished
1120 09:03:23.725353 (+   188us) write_op.cc:301] APPLY: starting
1120 09:03:23.725374 (+    21us) tablet.cc:1451] starting BulkCheckPresence
1120 09:03:23.725420 (+    46us) tablet.cc:1454] finished BulkCheckPresence
1120 09:03:23.725447 (+    27us) tablet.cc:1456] starting ApplyRowOperation cycle
1120 09:03:23.725563 (+   116us) tablet.cc:1467] finished ApplyRowOperation cycle
1120 09:03:23.725599 (+    36us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
1120 09:03:23.725608 (+     9us) write_op.cc:312] APPLY: finished
1120 09:03:23.725702 (+    94us) log.cc:844] Serialized 28 byte log entry
1120 09:03:23.725777 (+    75us) write_op.cc:494] Releasing partition, row and schema locks
1120 09:03:23.725800 (+    23us) write_op.cc:459] Released schema lock
1120 09:03:23.725807 (+     7us) write_op.cc:346] FINISH: Updating metrics
1120 09:03:23.725911 (+   104us) write_op.cc:494] Releasing partition, row and schema locks
1120 09:03:23.725918 (+     7us) write_op.cc:459] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":509921,"Hive Metastore.run_cpu_time_us":279,"Hive Metastore.run_wall_time_us":46595,"child_traces":[["op",{"apply.queue_time_us":117,"apply.run_cpu_time_us":536,"apply.run_wall_time_us":532,"num_ops":2,"prepare.queue_time_us":2960,"prepare.run_cpu_time_us":874,"prepare.run_wall_time_us":875,"raft.queue_time_us":75,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":16513}]]}
I20261120 09:03:23.727008 24315 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41728:
name: "default.Table_797fe36dbbf14c0c8e085d8470e75a24"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:23.729211 24930 ts_tablet_manager.cc:1962] T 703a95501e53451ea18439c1651c064d P 2c3fe57b9d2c424da181281af303f3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261120 09:03:23.734942 24930 ts_tablet_manager.cc:1975] T 703a95501e53451ea18439c1651c064d P 2c3fe57b9d2c424da181281af303f3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20261120 09:03:23.735083 24930 log.cc:1199] T 703a95501e53451ea18439c1651c064d P 2c3fe57b9d2c424da181281af303f3c3: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-0/wal/wals/703a95501e53451ea18439c1651c064d
I20261120 09:03:23.735414 24930 ts_tablet_manager.cc:1996] T 703a95501e53451ea18439c1651c064d P 2c3fe57b9d2c424da181281af303f3c3: Deleting consensus metadata
I20261120 09:03:23.736654 24305 catalog_manager.cc:5081] TS 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): tablet 703a95501e53451ea18439c1651c064d (table default.table_44e6e9d80f3244618eb164246f389566 [id=cb55967ea90e43be8da1354763f7984c]) successfully deleted
I20261120 09:03:23.737018 24930 tablet_replica.cc:333] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2c3fe57b9d2c424da181281af303f3c3: stopping tablet replica
I20261120 09:03:23.737185 24930 raft_consensus.cc:2440] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20261120 09:03:23.737334 24930 raft_consensus.cc:2469] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20261120 09:03:23.738294 24930 ts_tablet_manager.cc:1962] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2c3fe57b9d2c424da181281af303f3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261120 09:03:23.746779 24920 tablet_bootstrap.cc:492] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3: Bootstrap starting.
I20261120 09:03:23.748651 24920 tablet_bootstrap.cc:654] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.753265 24789 tablet_service.cc:1495] Processing CreateTablet for tablet e7f41973f62a48cf8b20ec4d965bfa6e (DEFAULT_TABLE table=default.table_d68821f474e040e18b4d91fbbd850863 [id=9d133f08f71d42b89628f2869cbaa424]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.753728 24789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7f41973f62a48cf8b20ec4d965bfa6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.755374 24918 tablet_bootstrap.cc:492] T 060080d353484c3a85560b493214e484 P 8668dad23e404dafb0ac25267f07bd46: No bootstrap required, opened a new log
I20261120 09:03:23.755559 24918 ts_tablet_manager.cc:1449] T 060080d353484c3a85560b493214e484 P 8668dad23e404dafb0ac25267f07bd46: Time spent bootstrapping tablet: real 0.050s	user 0.005s	sys 0.005s
I20261120 09:03:23.756451 24918 raft_consensus.cc:366] T 060080d353484c3a85560b493214e484 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.756666 24918 raft_consensus.cc:392] T 060080d353484c3a85560b493214e484 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:23.756762 24918 raft_consensus.cc:787] T 060080d353484c3a85560b493214e484 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Initialized, Role: FOLLOWER
I20261120 09:03:23.759092 24918 consensus_queue.cc:261] T 060080d353484c3a85560b493214e484 P 8668dad23e404dafb0ac25267f07bd46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.760215 24641 tablet_service.cc:1495] Processing CreateTablet for tablet e7f41973f62a48cf8b20ec4d965bfa6e (DEFAULT_TABLE table=default.table_d68821f474e040e18b4d91fbbd850863 [id=9d133f08f71d42b89628f2869cbaa424]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.762971 24930 ts_tablet_manager.cc:1975] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2c3fe57b9d2c424da181281af303f3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20261120 09:03:23.763119 24930 log.cc:1199] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2c3fe57b9d2c424da181281af303f3c3: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-0/wal/wals/b4a7f651c19e4912a8e0ea4b1bc2d319
I20261120 09:03:23.763096 24918 ts_tablet_manager.cc:1480] T 060080d353484c3a85560b493214e484 P 8668dad23e404dafb0ac25267f07bd46: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.002s
I20261120 09:03:23.763496 24930 ts_tablet_manager.cc:1996] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2c3fe57b9d2c424da181281af303f3c3: Deleting consensus metadata
I20261120 09:03:23.763922 24488 tablet_service.cc:1495] Processing CreateTablet for tablet e7f41973f62a48cf8b20ec4d965bfa6e (DEFAULT_TABLE table=default.table_d68821f474e040e18b4d91fbbd850863 [id=9d133f08f71d42b89628f2869cbaa424]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.764497 24488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7f41973f62a48cf8b20ec4d965bfa6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.764816 24305 catalog_manager.cc:5081] TS 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): tablet b4a7f651c19e4912a8e0ea4b1bc2d319 (table default.table_d5638af53ccf40f2b367cf74de29e633 [id=83bafe99e25046a4a43a3739a3ca07a1]) successfully deleted
I20261120 09:03:23.766490 24918 tablet_bootstrap.cc:492] T aa0f46d52f9b4608ba87baf575d59f89 P 8668dad23e404dafb0ac25267f07bd46: Bootstrap starting.
I20261120 09:03:23.768465 24918 tablet_bootstrap.cc:654] T aa0f46d52f9b4608ba87baf575d59f89 P 8668dad23e404dafb0ac25267f07bd46: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.774397 24920 tablet_bootstrap.cc:492] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3: No bootstrap required, opened a new log
I20261120 09:03:23.774578 24920 ts_tablet_manager.cc:1449] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3: Time spent bootstrapping tablet: real 0.028s	user 0.004s	sys 0.006s
I20261120 09:03:23.774731 24642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8cf83af75c745dc96cb98f99cd2335d. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.775367 24641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7f41973f62a48cf8b20ec4d965bfa6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.775254 24920 raft_consensus.cc:366] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.775476 24920 raft_consensus.cc:392] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:23.775535 24920 raft_consensus.cc:787] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Initialized, Role: FOLLOWER
I20261120 09:03:23.775830 24920 consensus_queue.cc:261] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.780895 24920 ts_tablet_manager.cc:1480] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.000s
I20261120 09:03:23.784207 24920 tablet_bootstrap.cc:492] T e7f41973f62a48cf8b20ec4d965bfa6e P 2c3fe57b9d2c424da181281af303f3c3: Bootstrap starting.
I20261120 09:03:23.785838 24920 tablet_bootstrap.cc:654] T e7f41973f62a48cf8b20ec4d965bfa6e P 2c3fe57b9d2c424da181281af303f3c3: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.794027 24929 ts_tablet_manager.cc:1975] T 703a95501e53451ea18439c1651c064d P 2fb9ff0dc3d849d7bcf95806233d2c62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20261120 09:03:23.794272 24929 log.cc:1199] T 703a95501e53451ea18439c1651c064d P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-1/wal/wals/703a95501e53451ea18439c1651c064d
I20261120 09:03:23.798126 24789 tablet_service.cc:1542] Processing DeleteTablet for tablet b4a7f651c19e4912a8e0ea4b1bc2d319 with delete_type TABLET_DATA_DELETED (replaced by tablet 060080d353484c3a85560b493214e484) from {username='slave'} at 127.0.0.1:43956
I20261120 09:03:23.798642 24788 tablet_service.cc:1542] Processing DeleteTablet for tablet 703a95501e53451ea18439c1651c064d with delete_type TABLET_DATA_DELETED (replaced by tablet bb6d14de3cb9421987fb9eeb16fbd199) from {username='slave'} at 127.0.0.1:43956
I20261120 09:03:23.800498 24928 ts_tablet_manager.cc:1975] T b68f23d363924777ad43e7cbe5981571 P 8668dad23e404dafb0ac25267f07bd46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20261120 09:03:23.801162 24919 ts_tablet_manager.cc:1480] T fa8252fc6fee4aa7b20b53a08623e358 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent starting tablet: real 0.144s	user 0.000s	sys 0.002s
I20261120 09:03:23.801328 24314 catalog_manager.cc:2218] created HMS catalog entry for table  [id=33f431752a024c38910eb2e3d135295a]
I20261120 09:03:23.809335 24314 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:41728 (request call id 8) took 1327 ms. Trace:
I20261120 09:03:23.809465 24314 rpcz_store.cc:276] 1120 09:03:22.481740 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:22.481845 (+   105us) service_pool.cc:224] Handling call
1120 09:03:23.147838 (+665993us) catalog_manager.cc:2145] Acquired catalog manager lock
1120 09:03:23.148330 (+   492us) catalog_manager.cc:2191] Created new table and tablet info
1120 09:03:23.801277 (+652947us) catalog_manager.cc:2217] Created new table in HMS catalog
1120 09:03:23.809078 (+  7801us) catalog_manager.cc:2251] Wrote table and tablets to system table
1120 09:03:23.809178 (+   100us) catalog_manager.cc:2285] Inserted table and tablets into CatalogManager maps
1120 09:03:23.809285 (+   107us) inbound_call.cc:177] Queueing success response
Related trace 'op':
1120 09:03:23.802016 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1120 09:03:23.802220 (+   204us) write_op.cc:437] Acquiring schema lock in shared mode
1120 09:03:23.802228 (+     8us) write_op.cc:440] Acquired schema lock
1120 09:03:23.802231 (+     3us) tablet.cc:710] Decoding operations
1120 09:03:23.802341 (+   110us) write_op.cc:625] Acquiring the partition lock for write op
1120 09:03:23.802365 (+    24us) write_op.cc:646] Partition lock acquired for write op
1120 09:03:23.802371 (+     6us) tablet.cc:742] Acquiring locks for 2 operations
1120 09:03:23.802467 (+    96us) tablet.cc:758] Row locks acquired
1120 09:03:23.802471 (+     4us) write_op.cc:260] PREPARE: finished
1120 09:03:23.802578 (+   107us) write_op.cc:270] Start()
1120 09:03:23.802636 (+    58us) write_op.cc:276] Timestamp: P: 1795165403802471 usec, L: 0
1120 09:03:23.802643 (+     7us) op_driver.cc:350] REPLICATION: starting
1120 09:03:23.802910 (+   267us) log.cc:844] Serialized 432 byte log entry
1120 09:03:23.808299 (+  5389us) op_driver.cc:466] REPLICATION: finished
1120 09:03:23.808513 (+   214us) write_op.cc:301] APPLY: starting
1120 09:03:23.808540 (+    27us) tablet.cc:1451] starting BulkCheckPresence
1120 09:03:23.808601 (+    61us) tablet.cc:1454] finished BulkCheckPresence
1120 09:03:23.808637 (+    36us) tablet.cc:1456] starting ApplyRowOperation cycle
1120 09:03:23.808758 (+   121us) tablet.cc:1467] finished ApplyRowOperation cycle
1120 09:03:23.808795 (+    37us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
1120 09:03:23.808803 (+     8us) write_op.cc:312] APPLY: finished
1120 09:03:23.808891 (+    88us) log.cc:844] Serialized 28 byte log entry
1120 09:03:23.808965 (+    74us) write_op.cc:494] Releasing partition, row and schema locks
1120 09:03:23.808986 (+    21us) write_op.cc:459] Released schema lock
1120 09:03:23.808992 (+     6us) write_op.cc:346] FINISH: Updating metrics
1120 09:03:23.809069 (+    77us) write_op.cc:494] Releasing partition, row and schema locks
1120 09:03:23.809073 (+     4us) write_op.cc:459] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":555395,"Hive Metastore.run_cpu_time_us":300,"Hive Metastore.run_wall_time_us":97121,"child_traces":[["op",{"apply.queue_time_us":144,"apply.run_cpu_time_us":557,"apply.run_wall_time_us":557,"num_ops":2,"prepare.queue_time_us":48,"prepare.run_cpu_time_us":1058,"prepare.run_wall_time_us":1481,"raft.queue_time_us":467,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":334,"replication_time_us":5622}]]}
I20261120 09:03:23.824712 24314 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41728:
name: "default.Table_b329d3b2bb9a409b9290011073304555"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:23.825091 24489 tablet_service.cc:1495] Processing CreateTablet for tablet be76b618f4f142849d785428cd83c0f5 (DEFAULT_TABLE table=default.table_b9d5ad28fd144956bd0715d85a6db556 [id=33f431752a024c38910eb2e3d135295a]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.825680 24489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be76b618f4f142849d785428cd83c0f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.824029 24642 tablet_service.cc:1495] Processing CreateTablet for tablet be76b618f4f142849d785428cd83c0f5 (DEFAULT_TABLE table=default.table_b9d5ad28fd144956bd0715d85a6db556 [id=33f431752a024c38910eb2e3d135295a]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.830114 24642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be76b618f4f142849d785428cd83c0f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.835520 24919 tablet_bootstrap.cc:492] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62: Bootstrap starting.
I20261120 09:03:23.837531 24919 tablet_bootstrap.cc:654] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.812440 24936 raft_consensus.cc:534] T 703a95501e53451ea18439c1651c064d P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:23.838857 24936 raft_consensus.cc:556] T 703a95501e53451ea18439c1651c064d P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } }
I20261120 09:03:23.841207 24936 leader_election.cc:290] T 703a95501e53451ea18439c1651c064d P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677), 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879)
I20261120 09:03:23.829525 24788 tablet_service.cc:1495] Processing CreateTablet for tablet be76b618f4f142849d785428cd83c0f5 (DEFAULT_TABLE table=default.table_b9d5ad28fd144956bd0715d85a6db556 [id=33f431752a024c38910eb2e3d135295a]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.851137 24788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be76b618f4f142849d785428cd83c0f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.854357 24928 log.cc:1199] T b68f23d363924777ad43e7cbe5981571 P 8668dad23e404dafb0ac25267f07bd46: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-2/wal/wals/b68f23d363924777ad43e7cbe5981571
I20261120 09:03:23.854897 24928 ts_tablet_manager.cc:1996] T b68f23d363924777ad43e7cbe5981571 P 8668dad23e404dafb0ac25267f07bd46: Deleting consensus metadata
I20261120 09:03:23.857013 24305 catalog_manager.cc:5081] TS 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): tablet b68f23d363924777ad43e7cbe5981571 (table default.table_eb77729285254174a498bb17a0adceea [id=90570e46cebe47eba97e5b980f23e909]) successfully deleted
I20261120 09:03:23.857765 24929 ts_tablet_manager.cc:1996] T 703a95501e53451ea18439c1651c064d P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting consensus metadata
I20261120 09:03:23.859258 24316 catalog_manager.cc:3588] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41728:
table { table_name: "default.Table_4bb4f7811f444da2b0eca6ab9e9203dd" } new_table_name: "default.Table_784f78c485a74606a638a81633a149e7" modify_external_catalogs: true
I20261120 09:03:23.864410 24307 catalog_manager.cc:5081] TS 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): tablet 703a95501e53451ea18439c1651c064d (table default.table_44e6e9d80f3244618eb164246f389566 [id=cb55967ea90e43be8da1354763f7984c]) successfully deleted
I20261120 09:03:23.866592 24929 tablet_replica.cc:333] T b68f23d363924777ad43e7cbe5981571 P 2fb9ff0dc3d849d7bcf95806233d2c62: stopping tablet replica
I20261120 09:03:23.866850 24929 raft_consensus.cc:2440] T b68f23d363924777ad43e7cbe5981571 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Raft consensus shutting down.
I20261120 09:03:23.867064 24929 raft_consensus.cc:2469] T b68f23d363924777ad43e7cbe5981571 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Raft consensus is shut down!
I20261120 09:03:23.867437 24928 tablet_replica.cc:333] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 8668dad23e404dafb0ac25267f07bd46: stopping tablet replica
I20261120 09:03:23.867671 24928 raft_consensus.cc:2440] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Raft consensus shutting down.
I20261120 09:03:23.867856 24928 raft_consensus.cc:2469] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Raft consensus is shut down!
I20261120 09:03:23.868268 24929 ts_tablet_manager.cc:1962] T b68f23d363924777ad43e7cbe5981571 P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting tablet data with delete state TABLET_DATA_DELETED
W20261120 09:03:23.874320 24744 leader_election.cc:343] T 703a95501e53451ea18439c1651c064d P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): Not found: Tablet not found: 703a95501e53451ea18439c1651c064d
I20261120 09:03:23.874658 24313 catalog_manager.cc:2218] created HMS catalog entry for table  [id=ec464d0cd5ec4ec2bc03ebb8a14481e0]
W20261120 09:03:23.877781 24742 leader_election.cc:343] T 703a95501e53451ea18439c1651c064d P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): Not found: Tablet not found: 703a95501e53451ea18439c1651c064d
I20261120 09:03:23.877923 24742 leader_election.cc:304] T 703a95501e53451ea18439c1651c064d P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8668dad23e404dafb0ac25267f07bd46; no voters: 2c3fe57b9d2c424da181281af303f3c3, 2fb9ff0dc3d849d7bcf95806233d2c62
I20261120 09:03:23.878695 24936 raft_consensus.cc:2966] T 703a95501e53451ea18439c1651c064d P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:03:23.880362 24918 tablet_bootstrap.cc:492] T aa0f46d52f9b4608ba87baf575d59f89 P 8668dad23e404dafb0ac25267f07bd46: No bootstrap required, opened a new log
I20261120 09:03:23.880527 24918 ts_tablet_manager.cc:1449] T aa0f46d52f9b4608ba87baf575d59f89 P 8668dad23e404dafb0ac25267f07bd46: Time spent bootstrapping tablet: real 0.114s	user 0.013s	sys 0.006s
I20261120 09:03:23.881459 24918 raft_consensus.cc:366] T aa0f46d52f9b4608ba87baf575d59f89 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.881688 24918 raft_consensus.cc:392] T aa0f46d52f9b4608ba87baf575d59f89 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:23.881788 24918 raft_consensus.cc:787] T aa0f46d52f9b4608ba87baf575d59f89 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Initialized, Role: FOLLOWER
I20261120 09:03:23.882093 24918 consensus_queue.cc:261] T aa0f46d52f9b4608ba87baf575d59f89 P 8668dad23e404dafb0ac25267f07bd46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.883469 24313 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:41728 (request call id 9) took 1401 ms. Trace:
I20261120 09:03:23.883582 24313 rpcz_store.cc:276] 1120 09:03:22.481935 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:22.481999 (+    64us) service_pool.cc:224] Handling call
1120 09:03:23.148991 (+666992us) catalog_manager.cc:2145] Acquired catalog manager lock
1120 09:03:23.149393 (+   402us) catalog_manager.cc:2191] Created new table and tablet info
1120 09:03:23.874614 (+725221us) catalog_manager.cc:2217] Created new table in HMS catalog
1120 09:03:23.883151 (+  8537us) catalog_manager.cc:2251] Wrote table and tablets to system table
1120 09:03:23.883280 (+   129us) catalog_manager.cc:2285] Inserted table and tablets into CatalogManager maps
1120 09:03:23.883431 (+   151us) inbound_call.cc:177] Queueing success response
Related trace 'op':
1120 09:03:23.875816 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1120 09:03:23.875964 (+   148us) write_op.cc:437] Acquiring schema lock in shared mode
1120 09:03:23.875971 (+     7us) write_op.cc:440] Acquired schema lock
1120 09:03:23.875974 (+     3us) tablet.cc:710] Decoding operations
1120 09:03:23.876088 (+   114us) write_op.cc:625] Acquiring the partition lock for write op
1120 09:03:23.876103 (+    15us) write_op.cc:646] Partition lock acquired for write op
1120 09:03:23.876109 (+     6us) tablet.cc:742] Acquiring locks for 2 operations
1120 09:03:23.876234 (+   125us) tablet.cc:758] Row locks acquired
1120 09:03:23.876237 (+     3us) write_op.cc:260] PREPARE: finished
1120 09:03:23.876282 (+    45us) write_op.cc:270] Start()
1120 09:03:23.876322 (+    40us) write_op.cc:276] Timestamp: P: 1795165403876227 usec, L: 0
1120 09:03:23.876327 (+     5us) op_driver.cc:350] REPLICATION: starting
1120 09:03:23.876541 (+   214us) log.cc:844] Serialized 432 byte log entry
1120 09:03:23.882110 (+  5569us) op_driver.cc:466] REPLICATION: finished
1120 09:03:23.882323 (+   213us) write_op.cc:301] APPLY: starting
1120 09:03:23.882345 (+    22us) tablet.cc:1451] starting BulkCheckPresence
1120 09:03:23.882398 (+    53us) tablet.cc:1454] finished BulkCheckPresence
1120 09:03:23.882442 (+    44us) tablet.cc:1456] starting ApplyRowOperation cycle
1120 09:03:23.882644 (+   202us) tablet.cc:1467] finished ApplyRowOperation cycle
1120 09:03:23.882688 (+    44us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
1120 09:03:23.882699 (+    11us) write_op.cc:312] APPLY: finished
1120 09:03:23.882809 (+   110us) log.cc:844] Serialized 28 byte log entry
1120 09:03:23.882888 (+    79us) write_op.cc:494] Releasing partition, row and schema locks
1120 09:03:23.882913 (+    25us) write_op.cc:459] Released schema lock
1120 09:03:23.882921 (+     8us) write_op.cc:346] FINISH: Updating metrics
1120 09:03:23.883006 (+    85us) write_op.cc:494] Releasing partition, row and schema locks
1120 09:03:23.883013 (+     7us) write_op.cc:459] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":651555,"Hive Metastore.run_cpu_time_us":265,"Hive Metastore.run_wall_time_us":73220,"child_traces":[["op",{"apply.queue_time_us":136,"apply.run_cpu_time_us":691,"apply.run_wall_time_us":690,"num_ops":2,"prepare.queue_time_us":539,"prepare.run_cpu_time_us":862,"prepare.run_wall_time_us":862,"raft.queue_time_us":1247,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":292,"replication_time_us":5745}]]}
I20261120 09:03:23.884272 24313 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41728:
name: "default.Table_f0940064a6844fdaadb8859f4257b11f"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:23.885737 24918 ts_tablet_manager.cc:1480] T aa0f46d52f9b4608ba87baf575d59f89 P 8668dad23e404dafb0ac25267f07bd46: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.001s
I20261120 09:03:23.887089 24918 tablet_bootstrap.cc:492] T e7f41973f62a48cf8b20ec4d965bfa6e P 8668dad23e404dafb0ac25267f07bd46: Bootstrap starting.
I20261120 09:03:23.889683 24929 ts_tablet_manager.cc:1975] T b68f23d363924777ad43e7cbe5981571 P 2fb9ff0dc3d849d7bcf95806233d2c62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20261120 09:03:23.890033 24918 tablet_bootstrap.cc:654] T e7f41973f62a48cf8b20ec4d965bfa6e P 8668dad23e404dafb0ac25267f07bd46: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.896943 24929 log.cc:1199] T b68f23d363924777ad43e7cbe5981571 P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-1/wal/wals/b68f23d363924777ad43e7cbe5981571
I20261120 09:03:23.899339 24929 ts_tablet_manager.cc:1996] T b68f23d363924777ad43e7cbe5981571 P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting consensus metadata
I20261120 09:03:23.900125 24641 tablet_service.cc:1495] Processing CreateTablet for tablet a48b8166531548208bf3ae77f7380555 (DEFAULT_TABLE table=default.table_d67fc59080cc4194b566604a649aefad [id=ec464d0cd5ec4ec2bc03ebb8a14481e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.900640 24641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a48b8166531548208bf3ae77f7380555. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.901896 24307 catalog_manager.cc:5081] TS 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): tablet b68f23d363924777ad43e7cbe5981571 (table default.table_eb77729285254174a498bb17a0adceea [id=90570e46cebe47eba97e5b980f23e909]) successfully deleted
I20261120 09:03:23.903177 24929 tablet_replica.cc:333] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2fb9ff0dc3d849d7bcf95806233d2c62: stopping tablet replica
I20261120 09:03:23.903795 24929 raft_consensus.cc:2440] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Raft consensus shutting down.
I20261120 09:03:23.903827 24488 tablet_service.cc:1495] Processing CreateTablet for tablet a48b8166531548208bf3ae77f7380555 (DEFAULT_TABLE table=default.table_d67fc59080cc4194b566604a649aefad [id=ec464d0cd5ec4ec2bc03ebb8a14481e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.904402 24488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a48b8166531548208bf3ae77f7380555. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.904851 24934 raft_consensus.cc:534] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:23.905110 24934 raft_consensus.cc:556] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.907320 24934 leader_election.cc:290] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:23.910993 24929 raft_consensus.cc:2469] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Raft consensus is shut down!
I20261120 09:03:23.912374 24929 ts_tablet_manager.cc:1962] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261120 09:03:23.917483 24662 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "aa0f46d52f9b4608ba87baf575d59f89" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" is_pre_election: true
W20261120 09:03:23.918556 24445 leader_election.cc:343] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): Illegal state: must be running to vote when last-logged opid is not known
I20261120 09:03:23.932051 24789 tablet_service.cc:1495] Processing CreateTablet for tablet a48b8166531548208bf3ae77f7380555 (DEFAULT_TABLE table=default.table_d67fc59080cc4194b566604a649aefad [id=ec464d0cd5ec4ec2bc03ebb8a14481e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:23.932775 24789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a48b8166531548208bf3ae77f7380555. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:23.943660 24919 tablet_bootstrap.cc:492] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62: No bootstrap required, opened a new log
I20261120 09:03:23.943956 24919 ts_tablet_manager.cc:1449] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent bootstrapping tablet: real 0.109s	user 0.001s	sys 0.003s
I20261120 09:03:23.944950 24919 raft_consensus.cc:366] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.945998 24918 tablet_bootstrap.cc:492] T e7f41973f62a48cf8b20ec4d965bfa6e P 8668dad23e404dafb0ac25267f07bd46: No bootstrap required, opened a new log
I20261120 09:03:23.946262 24918 ts_tablet_manager.cc:1449] T e7f41973f62a48cf8b20ec4d965bfa6e P 8668dad23e404dafb0ac25267f07bd46: Time spent bootstrapping tablet: real 0.059s	user 0.004s	sys 0.000s
I20261120 09:03:23.947209 24918 raft_consensus.cc:366] T e7f41973f62a48cf8b20ec4d965bfa6e P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:23.951443 24920 tablet_bootstrap.cc:492] T e7f41973f62a48cf8b20ec4d965bfa6e P 2c3fe57b9d2c424da181281af303f3c3: No bootstrap required, opened a new log
I20261120 09:03:23.951596 24920 ts_tablet_manager.cc:1449] T e7f41973f62a48cf8b20ec4d965bfa6e P 2c3fe57b9d2c424da181281af303f3c3: Time spent bootstrapping tablet: real 0.167s	user 0.020s	sys 0.027s
I20261120 09:03:23.952337 24920 raft_consensus.cc:366] T e7f41973f62a48cf8b20ec4d965bfa6e P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:23.952522 24920 raft_consensus.cc:392] T e7f41973f62a48cf8b20ec4d965bfa6e P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:23.952611 24920 raft_consensus.cc:787] T e7f41973f62a48cf8b20ec4d965bfa6e P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Initialized, Role: FOLLOWER
I20261120 09:03:23.952915 24920 consensus_queue.cc:261] T e7f41973f62a48cf8b20ec4d965bfa6e P 2c3fe57b9d2c424da181281af303f3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:23.954495 24920 ts_tablet_manager.cc:1480] T e7f41973f62a48cf8b20ec4d965bfa6e P 2c3fe57b9d2c424da181281af303f3c3: Time spent starting tablet: real 0.003s	user 0.001s	sys 0.001s
I20261120 09:03:23.954893 24920 tablet_bootstrap.cc:492] T be76b618f4f142849d785428cd83c0f5 P 2c3fe57b9d2c424da181281af303f3c3: Bootstrap starting.
I20261120 09:03:23.957672 24920 tablet_bootstrap.cc:654] T be76b618f4f142849d785428cd83c0f5 P 2c3fe57b9d2c424da181281af303f3c3: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.960500 24919 raft_consensus.cc:392] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:23.960659 24919 raft_consensus.cc:787] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Initialized, Role: FOLLOWER
I20261120 09:03:23.961028 24919 consensus_queue.cc:261] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.958834 24929 ts_tablet_manager.cc:1975] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2fb9ff0dc3d849d7bcf95806233d2c62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20261120 09:03:23.961515 24929 log.cc:1199] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-1/wal/wals/b4a7f651c19e4912a8e0ea4b1bc2d319
I20261120 09:03:23.961970 24929 ts_tablet_manager.cc:1996] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting consensus metadata
I20261120 09:03:23.964823 24307 catalog_manager.cc:5081] TS 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): tablet b4a7f651c19e4912a8e0ea4b1bc2d319 (table default.table_d5638af53ccf40f2b367cf74de29e633 [id=83bafe99e25046a4a43a3739a3ca07a1]) successfully deleted
I20261120 09:03:23.965304 24919 ts_tablet_manager.cc:1480] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent starting tablet: real 0.021s	user 0.001s	sys 0.001s
I20261120 09:03:23.966913 24919 tablet_bootstrap.cc:492] T aa0f46d52f9b4608ba87baf575d59f89 P 2fb9ff0dc3d849d7bcf95806233d2c62: Bootstrap starting.
I20261120 09:03:23.969089 24919 tablet_bootstrap.cc:654] T aa0f46d52f9b4608ba87baf575d59f89 P 2fb9ff0dc3d849d7bcf95806233d2c62: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.969287 24918 raft_consensus.cc:392] T e7f41973f62a48cf8b20ec4d965bfa6e P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:23.969429 24918 raft_consensus.cc:787] T e7f41973f62a48cf8b20ec4d965bfa6e P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Initialized, Role: FOLLOWER
I20261120 09:03:23.969805 24918 consensus_queue.cc:261] T e7f41973f62a48cf8b20ec4d965bfa6e P 8668dad23e404dafb0ac25267f07bd46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:23.971699 24918 ts_tablet_manager.cc:1480] T e7f41973f62a48cf8b20ec4d965bfa6e P 8668dad23e404dafb0ac25267f07bd46: Time spent starting tablet: real 0.025s	user 0.000s	sys 0.002s
I20261120 09:03:23.973027 24918 tablet_bootstrap.cc:492] T a8cf83af75c745dc96cb98f99cd2335d P 8668dad23e404dafb0ac25267f07bd46: Bootstrap starting.
I20261120 09:03:23.974828 24920 tablet_bootstrap.cc:492] T be76b618f4f142849d785428cd83c0f5 P 2c3fe57b9d2c424da181281af303f3c3: No bootstrap required, opened a new log
I20261120 09:03:23.948215 24928 ts_tablet_manager.cc:1962] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 8668dad23e404dafb0ac25267f07bd46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261120 09:03:23.958746 24809 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "aa0f46d52f9b4608ba87baf575d59f89" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46" is_pre_election: true
I20261120 09:03:23.975004 24920 ts_tablet_manager.cc:1449] T be76b618f4f142849d785428cd83c0f5 P 2c3fe57b9d2c424da181281af303f3c3: Time spent bootstrapping tablet: real 0.020s	user 0.001s	sys 0.006s
I20261120 09:03:23.975337 24809 raft_consensus.cc:2062] T aa0f46d52f9b4608ba87baf575d59f89 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 0
I20261120 09:03:23.975731 24920 raft_consensus.cc:366] T be76b618f4f142849d785428cd83c0f5 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.975943 24920 raft_consensus.cc:392] T be76b618f4f142849d785428cd83c0f5 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:23.976012 24920 raft_consensus.cc:787] T be76b618f4f142849d785428cd83c0f5 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Initialized, Role: FOLLOWER
I20261120 09:03:23.976279 24920 consensus_queue.cc:261] T be76b618f4f142849d785428cd83c0f5 P 2c3fe57b9d2c424da181281af303f3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.977182 24920 ts_tablet_manager.cc:1480] T be76b618f4f142849d785428cd83c0f5 P 2c3fe57b9d2c424da181281af303f3c3: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
I20261120 09:03:23.977550 24920 tablet_bootstrap.cc:492] T a48b8166531548208bf3ae77f7380555 P 2c3fe57b9d2c424da181281af303f3c3: Bootstrap starting.
I20261120 09:03:23.978123 24443 leader_election.cc:304] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46; no voters: 2fb9ff0dc3d849d7bcf95806233d2c62
I20261120 09:03:23.979739 24920 tablet_bootstrap.cc:654] T a48b8166531548208bf3ae77f7380555 P 2c3fe57b9d2c424da181281af303f3c3: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.979981 24934 raft_consensus.cc:3024] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261120 09:03:23.980171 24934 raft_consensus.cc:534] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261120 09:03:23.980310 24934 raft_consensus.cc:3296] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:23.986311 24920 tablet_bootstrap.cc:492] T a48b8166531548208bf3ae77f7380555 P 2c3fe57b9d2c424da181281af303f3c3: No bootstrap required, opened a new log
I20261120 09:03:23.986444 24920 ts_tablet_manager.cc:1449] T a48b8166531548208bf3ae77f7380555 P 2c3fe57b9d2c424da181281af303f3c3: Time spent bootstrapping tablet: real 0.009s	user 0.000s	sys 0.006s
I20261120 09:03:23.987105 24920 raft_consensus.cc:366] T a48b8166531548208bf3ae77f7380555 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.987293 24920 raft_consensus.cc:392] T a48b8166531548208bf3ae77f7380555 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:23.987375 24920 raft_consensus.cc:787] T a48b8166531548208bf3ae77f7380555 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Initialized, Role: FOLLOWER
I20261120 09:03:23.987607 24920 consensus_queue.cc:261] T a48b8166531548208bf3ae77f7380555 P 2c3fe57b9d2c424da181281af303f3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.989348 24934 raft_consensus.cc:556] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:23.992458 24918 tablet_bootstrap.cc:654] T a8cf83af75c745dc96cb98f99cd2335d P 8668dad23e404dafb0ac25267f07bd46: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:23.992964 24934 leader_election.cc:290] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 election: Requested vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:23.993021 24920 ts_tablet_manager.cc:1480] T a48b8166531548208bf3ae77f7380555 P 2c3fe57b9d2c424da181281af303f3c3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20261120 09:03:23.992575 24662 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "aa0f46d52f9b4608ba87baf575d59f89" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62"
I20261120 09:03:23.993520 24809 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "aa0f46d52f9b4608ba87baf575d59f89" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46"
I20261120 09:03:23.993729 24809 raft_consensus.cc:3296] T aa0f46d52f9b4608ba87baf575d59f89 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Advancing to term 1
W20261120 09:03:23.993829 24445 leader_election.cc:343] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): Illegal state: must be running to vote when last-logged opid is not known
I20261120 09:03:23.994346 24809 raft_consensus.cc:2062] T aa0f46d52f9b4608ba87baf575d59f89 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 1
I20261120 09:03:23.997804 24443 leader_election.cc:304] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46; no voters: 2fb9ff0dc3d849d7bcf95806233d2c62
I20261120 09:03:23.998299 24970 raft_consensus.cc:3024] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Leader election won for term 1
I20261120 09:03:23.998541 24970 raft_consensus.cc:744] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 LEADER]: Becoming Leader. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Running, Role: LEADER
I20261120 09:03:23.999910 24970 consensus_queue.cc:238] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.000092 24312 catalog_manager.cc:2218] created HMS catalog entry for table  [id=268c82ae3c7448059e7674f73aad3114]
I20261120 09:03:24.004940 24928 ts_tablet_manager.cc:1975] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 8668dad23e404dafb0ac25267f07bd46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20261120 09:03:24.005089 24928 log.cc:1199] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 8668dad23e404dafb0ac25267f07bd46: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-2/wal/wals/b4a7f651c19e4912a8e0ea4b1bc2d319
I20261120 09:03:24.005575 24928 ts_tablet_manager.cc:1996] T b4a7f651c19e4912a8e0ea4b1bc2d319 P 8668dad23e404dafb0ac25267f07bd46: Deleting consensus metadata
I20261120 09:03:24.006873 24305 catalog_manager.cc:5081] TS 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): tablet b4a7f651c19e4912a8e0ea4b1bc2d319 (table default.table_d5638af53ccf40f2b367cf74de29e633 [id=83bafe99e25046a4a43a3739a3ca07a1]) successfully deleted
I20261120 09:03:24.007369 24312 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:41728 (request call id 10) took 1524 ms. Trace:
I20261120 09:03:24.007539 24312 rpcz_store.cc:276] 1120 09:03:22.483327 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:22.483406 (+    79us) service_pool.cc:224] Handling call
1120 09:03:23.149902 (+666496us) catalog_manager.cc:2145] Acquired catalog manager lock
1120 09:03:23.150290 (+   388us) catalog_manager.cc:2191] Created new table and tablet info
1120 09:03:24.000041 (+849751us) catalog_manager.cc:2217] Created new table in HMS catalog
1120 09:03:24.007063 (+  7022us) catalog_manager.cc:2251] Wrote table and tablets to system table
1120 09:03:24.007171 (+   108us) catalog_manager.cc:2285] Inserted table and tablets into CatalogManager maps
1120 09:03:24.007320 (+   149us) inbound_call.cc:177] Queueing success response
Related trace 'op':
1120 09:03:24.000822 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1120 09:03:24.000987 (+   165us) write_op.cc:437] Acquiring schema lock in shared mode
1120 09:03:24.000994 (+     7us) write_op.cc:440] Acquired schema lock
1120 09:03:24.000996 (+     2us) tablet.cc:710] Decoding operations
1120 09:03:24.001093 (+    97us) write_op.cc:625] Acquiring the partition lock for write op
1120 09:03:24.001108 (+    15us) write_op.cc:646] Partition lock acquired for write op
1120 09:03:24.001113 (+     5us) tablet.cc:742] Acquiring locks for 2 operations
1120 09:03:24.001207 (+    94us) tablet.cc:758] Row locks acquired
1120 09:03:24.001210 (+     3us) write_op.cc:260] PREPARE: finished
1120 09:03:24.001245 (+    35us) write_op.cc:270] Start()
1120 09:03:24.001279 (+    34us) write_op.cc:276] Timestamp: P: 1795165404001177 usec, L: 0
1120 09:03:24.001283 (+     4us) op_driver.cc:350] REPLICATION: starting
1120 09:03:24.001461 (+   178us) log.cc:844] Serialized 432 byte log entry
1120 09:03:24.004751 (+  3290us) op_driver.cc:466] REPLICATION: finished
1120 09:03:24.004913 (+   162us) write_op.cc:301] APPLY: starting
1120 09:03:24.004931 (+    18us) tablet.cc:1451] starting BulkCheckPresence
1120 09:03:24.004977 (+    46us) tablet.cc:1454] finished BulkCheckPresence
1120 09:03:24.005009 (+    32us) tablet.cc:1456] starting ApplyRowOperation cycle
1120 09:03:24.005141 (+   132us) tablet.cc:1467] finished ApplyRowOperation cycle
1120 09:03:24.005185 (+    44us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
1120 09:03:24.005208 (+    23us) write_op.cc:312] APPLY: finished
1120 09:03:24.005379 (+   171us) log.cc:844] Serialized 28 byte log entry
1120 09:03:24.005450 (+    71us) write_op.cc:494] Releasing partition, row and schema locks
1120 09:03:24.005474 (+    24us) write_op.cc:459] Released schema lock
1120 09:03:24.005483 (+     9us) write_op.cc:346] FINISH: Updating metrics
1120 09:03:24.005572 (+    89us) write_op.cc:494] Releasing partition, row and schema locks
1120 09:03:24.005576 (+     4us) write_op.cc:459] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":723945,"Hive Metastore.run_cpu_time_us":330,"Hive Metastore.run_wall_time_us":125527,"child_traces":[["op",{"apply.queue_time_us":111,"apply.run_cpu_time_us":637,"apply.run_wall_time_us":637,"num_ops":2,"prepare.queue_time_us":50,"prepare.run_cpu_time_us":781,"prepare.run_wall_time_us":781,"raft.queue_time_us":547,"raft.run_cpu_time_us":397,"raft.run_wall_time_us":399,"replication_time_us":3423}]]}
I20261120 09:03:24.013885 24928 tablet_replica.cc:333] T 703a95501e53451ea18439c1651c064d P 8668dad23e404dafb0ac25267f07bd46: stopping tablet replica
I20261120 09:03:24.014093 24928 raft_consensus.cc:2440] T 703a95501e53451ea18439c1651c064d P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Raft consensus shutting down.
I20261120 09:03:24.014294 24928 raft_consensus.cc:2469] T 703a95501e53451ea18439c1651c064d P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Raft consensus is shut down!
I20261120 09:03:24.016615 24919 tablet_bootstrap.cc:492] T aa0f46d52f9b4608ba87baf575d59f89 P 2fb9ff0dc3d849d7bcf95806233d2c62: No bootstrap required, opened a new log
I20261120 09:03:24.016793 24919 ts_tablet_manager.cc:1449] T aa0f46d52f9b4608ba87baf575d59f89 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent bootstrapping tablet: real 0.050s	user 0.001s	sys 0.002s
I20261120 09:03:24.017627 24919 raft_consensus.cc:366] T aa0f46d52f9b4608ba87baf575d59f89 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.017844 24919 raft_consensus.cc:392] T aa0f46d52f9b4608ba87baf575d59f89 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:24.017940 24919 raft_consensus.cc:787] T aa0f46d52f9b4608ba87baf575d59f89 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Initialized, Role: FOLLOWER
I20261120 09:03:24.018185 24919 consensus_queue.cc:261] T aa0f46d52f9b4608ba87baf575d59f89 P 2fb9ff0dc3d849d7bcf95806233d2c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.018728 24919 ts_tablet_manager.cc:1480] T aa0f46d52f9b4608ba87baf575d59f89 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.001s
I20261120 09:03:24.019416 24928 ts_tablet_manager.cc:1962] T 703a95501e53451ea18439c1651c064d P 8668dad23e404dafb0ac25267f07bd46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261120 09:03:24.020995 24312 master_service.cc:965] ReplaceTablet: received request to replace tablet fa8252fc6fee4aa7b20b53a08623e358 from {username='slave'} at 127.0.0.1:41728
I20261120 09:03:24.025470 24928 ts_tablet_manager.cc:1975] T 703a95501e53451ea18439c1651c064d P 8668dad23e404dafb0ac25267f07bd46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20261120 09:03:24.025592 24928 log.cc:1199] T 703a95501e53451ea18439c1651c064d P 8668dad23e404dafb0ac25267f07bd46: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-2/wal/wals/703a95501e53451ea18439c1651c064d
I20261120 09:03:24.025960 24928 ts_tablet_manager.cc:1996] T 703a95501e53451ea18439c1651c064d P 8668dad23e404dafb0ac25267f07bd46: Deleting consensus metadata
I20261120 09:03:24.027035 24305 catalog_manager.cc:5081] TS 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): tablet 703a95501e53451ea18439c1651c064d (table default.table_44e6e9d80f3244618eb164246f389566 [id=cb55967ea90e43be8da1354763f7984c]) successfully deleted
I20261120 09:03:24.029414 24642 tablet_service.cc:1495] Processing CreateTablet for tablet 8155295b7e8e40ddaedeb2e9c24f1245 (DEFAULT_TABLE table=default.table_b2351eb1045a47feb0ca7b7422706581 [id=268c82ae3c7448059e7674f73aad3114]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:24.029801 24642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8155295b7e8e40ddaedeb2e9c24f1245. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:24.032217 24489 tablet_service.cc:1495] Processing CreateTablet for tablet 8155295b7e8e40ddaedeb2e9c24f1245 (DEFAULT_TABLE table=default.table_b2351eb1045a47feb0ca7b7422706581 [id=268c82ae3c7448059e7674f73aad3114]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:24.032618 24489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8155295b7e8e40ddaedeb2e9c24f1245. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:24.034637 24969 raft_consensus.cc:534] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:24.034791 24969 raft_consensus.cc:556] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.035874 24662 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "fa8252fc6fee4aa7b20b53a08623e358" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" is_pre_election: true
I20261120 09:03:24.036242 24662 raft_consensus.cc:2062] T fa8252fc6fee4aa7b20b53a08623e358 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 0
I20261120 09:03:24.036253 24788 tablet_service.cc:1495] Processing CreateTablet for tablet 8155295b7e8e40ddaedeb2e9c24f1245 (DEFAULT_TABLE table=default.table_b2351eb1045a47feb0ca7b7422706581 [id=268c82ae3c7448059e7674f73aad3114]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:24.036660 24788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8155295b7e8e40ddaedeb2e9c24f1245. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:24.036720 24445 leader_election.cc:304] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 
I20261120 09:03:24.037019 24934 raft_consensus.cc:3024] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261120 09:03:24.037110 24934 raft_consensus.cc:534] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261120 09:03:24.037220 24934 raft_consensus.cc:3296] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.038789 24312 catalog_manager.cc:6151] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: Sending DeleteTablet for 3 replicas of tablet fa8252fc6fee4aa7b20b53a08623e358
I20261120 09:03:24.039324 24312 catalog_manager.cc:6952] ReplaceTablet: tablet fa8252fc6fee4aa7b20b53a08623e358 deleted and replaced by tablet 707757cc32af4fe98d4a04e6a7498c17
I20261120 09:03:24.040019 24789 tablet_service.cc:1542] Processing DeleteTablet for tablet fa8252fc6fee4aa7b20b53a08623e358 with delete_type TABLET_DATA_DELETED (replaced by tablet 707757cc32af4fe98d4a04e6a7498c17) from {username='slave'} at 127.0.0.1:43956
I20261120 09:03:24.040295 24641 tablet_service.cc:1542] Processing DeleteTablet for tablet fa8252fc6fee4aa7b20b53a08623e358 with delete_type TABLET_DATA_DELETED (replaced by tablet 707757cc32af4fe98d4a04e6a7498c17) from {username='slave'} at 127.0.0.1:40170
I20261120 09:03:24.040539 24929 tablet_replica.cc:333] T fa8252fc6fee4aa7b20b53a08623e358 P 2fb9ff0dc3d849d7bcf95806233d2c62: stopping tablet replica
I20261120 09:03:24.040771 24929 raft_consensus.cc:2440] T fa8252fc6fee4aa7b20b53a08623e358 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Raft consensus shutting down.
I20261120 09:03:24.040961 24929 raft_consensus.cc:2469] T fa8252fc6fee4aa7b20b53a08623e358 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Raft consensus is shut down!
I20261120 09:03:24.042197 24929 ts_tablet_manager.cc:1962] T fa8252fc6fee4aa7b20b53a08623e358 P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261120 09:03:24.045742 24933 raft_consensus.cc:534] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:24.045953 24933 raft_consensus.cc:556] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.047160 24969 leader_election.cc:290] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:24.047995 24933 leader_election.cc:290] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677), 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:24.050845 24919 tablet_bootstrap.cc:492] T e7f41973f62a48cf8b20ec4d965bfa6e P 2fb9ff0dc3d849d7bcf95806233d2c62: Bootstrap starting.
I20261120 09:03:24.057153 24809 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "fa8252fc6fee4aa7b20b53a08623e358" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46" is_pre_election: true
I20261120 09:03:24.057433 24809 raft_consensus.cc:2062] T fa8252fc6fee4aa7b20b53a08623e358 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 0
I20261120 09:03:24.060599 24919 tablet_bootstrap.cc:654] T e7f41973f62a48cf8b20ec4d965bfa6e P 2fb9ff0dc3d849d7bcf95806233d2c62: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:24.064901 24929 ts_tablet_manager.cc:1975] T fa8252fc6fee4aa7b20b53a08623e358 P 2fb9ff0dc3d849d7bcf95806233d2c62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20261120 09:03:24.065069 24929 log.cc:1199] T fa8252fc6fee4aa7b20b53a08623e358 P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-1/wal/wals/fa8252fc6fee4aa7b20b53a08623e358
I20261120 09:03:24.065478 24929 ts_tablet_manager.cc:1996] T fa8252fc6fee4aa7b20b53a08623e358 P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting consensus metadata
I20261120 09:03:24.067597 24934 raft_consensus.cc:556] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
W20261120 09:03:24.069226 24445 leader_election.cc:343] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): Not found: Tablet not found: fa8252fc6fee4aa7b20b53a08623e358
I20261120 09:03:24.070070 24809 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "fa8252fc6fee4aa7b20b53a08623e358" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46"
I20261120 09:03:24.070315 24809 raft_consensus.cc:3296] T fa8252fc6fee4aa7b20b53a08623e358 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.070667 24809 raft_consensus.cc:2062] T fa8252fc6fee4aa7b20b53a08623e358 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 1
I20261120 09:03:24.070806 24934 leader_election.cc:290] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 election: Requested vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:24.073472 24443 leader_election.cc:304] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46; no voters: 2fb9ff0dc3d849d7bcf95806233d2c62
I20261120 09:03:24.074568 24662 raft_consensus.cc:3296] T aa0f46d52f9b4608ba87baf575d59f89 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.079342 24934 raft_consensus.cc:3024] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Leader election won for term 1
I20261120 09:03:24.079883 24510 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "060080d353484c3a85560b493214e484" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3" is_pre_election: true
I20261120 09:03:24.080379 24974 consensus_queue.cc:1049] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:24.090914 24510 raft_consensus.cc:2062] T 060080d353484c3a85560b493214e484 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 2fb9ff0dc3d849d7bcf95806233d2c62 in term 0
I20261120 09:03:24.091542 24595 leader_election.cc:304] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 
I20261120 09:03:24.091956 24933 raft_consensus.cc:3024] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261120 09:03:24.092067 24933 raft_consensus.cc:534] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261120 09:03:24.092152 24933 raft_consensus.cc:3296] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.092993 24488 tablet_service.cc:1542] Processing DeleteTablet for tablet fa8252fc6fee4aa7b20b53a08623e358 with delete_type TABLET_DATA_DELETED (replaced by tablet 707757cc32af4fe98d4a04e6a7498c17) from {username='slave'} at 127.0.0.1:50044
I20261120 09:03:24.092986 24808 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "060080d353484c3a85560b493214e484" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46" is_pre_election: true
I20261120 09:03:24.093384 24808 raft_consensus.cc:2062] T 060080d353484c3a85560b493214e484 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 2fb9ff0dc3d849d7bcf95806233d2c62 in term 0
I20261120 09:03:24.093711 24930 tablet_replica.cc:333] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3: stopping tablet replica
I20261120 09:03:24.098595 24969 consensus_queue.cc:1049] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:24.104545 24933 raft_consensus.cc:556] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.109629 24928 tablet_replica.cc:333] T fa8252fc6fee4aa7b20b53a08623e358 P 8668dad23e404dafb0ac25267f07bd46: stopping tablet replica
I20261120 09:03:24.109860 24928 raft_consensus.cc:2440] T fa8252fc6fee4aa7b20b53a08623e358 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20261120 09:03:24.110026 24928 raft_consensus.cc:2469] T fa8252fc6fee4aa7b20b53a08623e358 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261120 09:03:24.112049 24789 tablet_service.cc:1495] Processing CreateTablet for tablet 707757cc32af4fe98d4a04e6a7498c17 (DEFAULT_TABLE table=default.table_eb77729285254174a498bb17a0adceea [id=90570e46cebe47eba97e5b980f23e909]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:24.112586 24789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 707757cc32af4fe98d4a04e6a7498c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:24.112447 24312 catalog_manager.cc:5856] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65). New cstate: current_term: 1 leader_uuid: "2c3fe57b9d2c424da181281af303f3c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } health_report { overall_health: UNKNOWN } } }
I20261120 09:03:24.112983 24928 ts_tablet_manager.cc:1962] T fa8252fc6fee4aa7b20b53a08623e358 P 8668dad23e404dafb0ac25267f07bd46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261120 09:03:24.116184 24307 catalog_manager.cc:5081] TS 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): tablet fa8252fc6fee4aa7b20b53a08623e358 (table default.table_eb77729285254174a498bb17a0adceea [id=90570e46cebe47eba97e5b980f23e909]) successfully deleted
I20261120 09:03:24.123654 24312 master_service.cc:965] ReplaceTablet: received request to replace tablet bb6d14de3cb9421987fb9eeb16fbd199 from {username='slave'} at 127.0.0.1:41728
I20261120 09:03:24.125123 24933 leader_election.cc:290] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 election: Requested vote from peers 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677), 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:24.125140 24510 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "060080d353484c3a85560b493214e484" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3"
I20261120 09:03:24.125358 24510 raft_consensus.cc:3296] T 060080d353484c3a85560b493214e484 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.125407 24808 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "060080d353484c3a85560b493214e484" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46"
I20261120 09:03:24.125588 24808 raft_consensus.cc:3296] T 060080d353484c3a85560b493214e484 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.125774 24510 raft_consensus.cc:2062] T 060080d353484c3a85560b493214e484 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 2fb9ff0dc3d849d7bcf95806233d2c62 in term 1
I20261120 09:03:24.125907 24808 raft_consensus.cc:2062] T 060080d353484c3a85560b493214e484 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 2fb9ff0dc3d849d7bcf95806233d2c62 in term 1
I20261120 09:03:24.129109 24595 leader_election.cc:304] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62, 8668dad23e404dafb0ac25267f07bd46; no voters: 
I20261120 09:03:24.129576 24933 raft_consensus.cc:3024] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Leader election won for term 1
I20261120 09:03:24.129834 24933 raft_consensus.cc:744] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 LEADER]: Becoming Leader. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Running, Role: LEADER
I20261120 09:03:24.130432 24641 tablet_service.cc:1495] Processing CreateTablet for tablet 707757cc32af4fe98d4a04e6a7498c17 (DEFAULT_TABLE table=default.table_eb77729285254174a498bb17a0adceea [id=90570e46cebe47eba97e5b980f23e909]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:24.130553 24933 consensus_queue.cc:238] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.130889 24641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 707757cc32af4fe98d4a04e6a7498c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:24.131583 24920 tablet_bootstrap.cc:492] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2c3fe57b9d2c424da181281af303f3c3: Bootstrap starting.
I20261120 09:03:24.133399 24920 tablet_bootstrap.cc:654] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2c3fe57b9d2c424da181281af303f3c3: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:24.135303 24488 tablet_service.cc:1495] Processing CreateTablet for tablet 707757cc32af4fe98d4a04e6a7498c17 (DEFAULT_TABLE table=default.table_eb77729285254174a498bb17a0adceea [id=90570e46cebe47eba97e5b980f23e909]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:24.135685 24488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 707757cc32af4fe98d4a04e6a7498c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:24.147189 24920 tablet_bootstrap.cc:492] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2c3fe57b9d2c424da181281af303f3c3: No bootstrap required, opened a new log
I20261120 09:03:24.147393 24920 ts_tablet_manager.cc:1449] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2c3fe57b9d2c424da181281af303f3c3: Time spent bootstrapping tablet: real 0.016s	user 0.001s	sys 0.007s
I20261120 09:03:24.148411 24920 raft_consensus.cc:366] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:24.148622 24920 raft_consensus.cc:392] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:24.148757 24920 raft_consensus.cc:787] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Initialized, Role: FOLLOWER
I20261120 09:03:24.149057 24920 consensus_queue.cc:261] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2c3fe57b9d2c424da181281af303f3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:24.151239 24920 ts_tablet_manager.cc:1480] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2c3fe57b9d2c424da181281af303f3c3: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.002s
I20261120 09:03:24.155107 24312 catalog_manager.cc:6151] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: Sending DeleteTablet for 3 replicas of tablet bb6d14de3cb9421987fb9eeb16fbd199
I20261120 09:03:24.156649 24312 catalog_manager.cc:6952] ReplaceTablet: tablet bb6d14de3cb9421987fb9eeb16fbd199 deleted and replaced by tablet 8732692e59194cdabba0578275da133b
I20261120 09:03:24.162669 24489 tablet_service.cc:1542] Processing DeleteTablet for tablet bb6d14de3cb9421987fb9eeb16fbd199 with delete_type TABLET_DATA_DELETED (replaced by tablet 8732692e59194cdabba0578275da133b) from {username='slave'} at 127.0.0.1:50044
I20261120 09:03:24.165184 24312 master_service.cc:965] ReplaceTablet: received request to replace tablet aa0f46d52f9b4608ba87baf575d59f89 from {username='slave'} at 127.0.0.1:41728
I20261120 09:03:24.169070 24789 tablet_service.cc:1495] Processing CreateTablet for tablet 8732692e59194cdabba0578275da133b (DEFAULT_TABLE table=default.table_44e6e9d80f3244618eb164246f389566 [id=cb55967ea90e43be8da1354763f7984c]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:24.171069 24789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8732692e59194cdabba0578275da133b. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:24.176489 24928 ts_tablet_manager.cc:1975] T fa8252fc6fee4aa7b20b53a08623e358 P 8668dad23e404dafb0ac25267f07bd46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20261120 09:03:24.176631 24928 log.cc:1199] T fa8252fc6fee4aa7b20b53a08623e358 P 8668dad23e404dafb0ac25267f07bd46: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-2/wal/wals/fa8252fc6fee4aa7b20b53a08623e358
I20261120 09:03:24.177037 24928 ts_tablet_manager.cc:1996] T fa8252fc6fee4aa7b20b53a08623e358 P 8668dad23e404dafb0ac25267f07bd46: Deleting consensus metadata
I20261120 09:03:24.162499 24788 tablet_service.cc:1542] Processing DeleteTablet for tablet bb6d14de3cb9421987fb9eeb16fbd199 with delete_type TABLET_DATA_DELETED (replaced by tablet 8732692e59194cdabba0578275da133b) from {username='slave'} at 127.0.0.1:43956
I20261120 09:03:24.179941 24489 tablet_service.cc:1495] Processing CreateTablet for tablet 8732692e59194cdabba0578275da133b (DEFAULT_TABLE table=default.table_44e6e9d80f3244618eb164246f389566 [id=cb55967ea90e43be8da1354763f7984c]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:24.180501 24489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8732692e59194cdabba0578275da133b. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:24.185500 24305 catalog_manager.cc:5081] TS 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): tablet fa8252fc6fee4aa7b20b53a08623e358 (table default.table_eb77729285254174a498bb17a0adceea [id=90570e46cebe47eba97e5b980f23e909]) successfully deleted
I20261120 09:03:24.186292 24928 tablet_replica.cc:333] T bb6d14de3cb9421987fb9eeb16fbd199 P 8668dad23e404dafb0ac25267f07bd46: stopping tablet replica
I20261120 09:03:24.186496 24928 raft_consensus.cc:2440] T bb6d14de3cb9421987fb9eeb16fbd199 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Raft consensus shutting down.
I20261120 09:03:24.186686 24928 raft_consensus.cc:2469] T bb6d14de3cb9421987fb9eeb16fbd199 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Raft consensus is shut down!
I20261120 09:03:24.187989 24919 tablet_bootstrap.cc:492] T e7f41973f62a48cf8b20ec4d965bfa6e P 2fb9ff0dc3d849d7bcf95806233d2c62: No bootstrap required, opened a new log
I20261120 09:03:24.188838 24919 ts_tablet_manager.cc:1449] T e7f41973f62a48cf8b20ec4d965bfa6e P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent bootstrapping tablet: real 0.137s	user 0.004s	sys 0.001s
I20261120 09:03:24.190979 24312 catalog_manager.cc:6151] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: Sending DeleteTablet for 3 replicas of tablet aa0f46d52f9b4608ba87baf575d59f89
I20261120 09:03:24.191741 24490 tablet_service.cc:1542] Processing DeleteTablet for tablet aa0f46d52f9b4608ba87baf575d59f89 with delete_type TABLET_DATA_DELETED (replaced by tablet a27e6c05e40742d4ab0116c2e22cd4ba) from {username='slave'} at 127.0.0.1:50044
I20261120 09:03:24.192459 24920 tablet_bootstrap.cc:492] T 707757cc32af4fe98d4a04e6a7498c17 P 2c3fe57b9d2c424da181281af303f3c3: Bootstrap starting.
I20261120 09:03:24.193676 24312 catalog_manager.cc:6952] ReplaceTablet: tablet aa0f46d52f9b4608ba87baf575d59f89 deleted and replaced by tablet a27e6c05e40742d4ab0116c2e22cd4ba
I20261120 09:03:24.194389 24920 tablet_bootstrap.cc:654] T 707757cc32af4fe98d4a04e6a7498c17 P 2c3fe57b9d2c424da181281af303f3c3: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:24.196906 24969 raft_consensus.cc:534] T 75e156478a8a470ba5f4942cd8e6a89e P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:24.199127 24969 raft_consensus.cc:556] T 75e156478a8a470ba5f4942cd8e6a89e P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.187279 24928 ts_tablet_manager.cc:1962] T bb6d14de3cb9421987fb9eeb16fbd199 P 8668dad23e404dafb0ac25267f07bd46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261120 09:03:24.193564 24788 tablet_service.cc:1542] Processing DeleteTablet for tablet aa0f46d52f9b4608ba87baf575d59f89 with delete_type TABLET_DATA_DELETED (replaced by tablet a27e6c05e40742d4ab0116c2e22cd4ba) from {username='slave'} at 127.0.0.1:43956
I20261120 09:03:24.202016 24808 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "75e156478a8a470ba5f4942cd8e6a89e" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46" is_pre_election: true
I20261120 09:03:24.203023 24808 raft_consensus.cc:2062] T 75e156478a8a470ba5f4942cd8e6a89e P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 0
I20261120 09:03:24.203459 24443 leader_election.cc:304] T 75e156478a8a470ba5f4942cd8e6a89e P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46; no voters: 
I20261120 09:03:24.198786 24918 tablet_bootstrap.cc:492] T a8cf83af75c745dc96cb98f99cd2335d P 8668dad23e404dafb0ac25267f07bd46: No bootstrap required, opened a new log
I20261120 09:03:24.203853 24980 raft_consensus.cc:3024] T 75e156478a8a470ba5f4942cd8e6a89e P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261120 09:03:24.203891 24918 ts_tablet_manager.cc:1449] T a8cf83af75c745dc96cb98f99cd2335d P 8668dad23e404dafb0ac25267f07bd46: Time spent bootstrapping tablet: real 0.231s	user 0.003s	sys 0.005s
I20261120 09:03:24.203991 24980 raft_consensus.cc:534] T 75e156478a8a470ba5f4942cd8e6a89e P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261120 09:03:24.204104 24980 raft_consensus.cc:3296] T 75e156478a8a470ba5f4942cd8e6a89e P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.205582 24919 raft_consensus.cc:366] T e7f41973f62a48cf8b20ec4d965bfa6e P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:24.205971 24312 master_service.cc:965] ReplaceTablet: received request to replace tablet fa8252fc6fee4aa7b20b53a08623e358 from {username='slave'} at 127.0.0.1:41728
I20261120 09:03:24.206146 24490 tablet_service.cc:1495] Processing CreateTablet for tablet a27e6c05e40742d4ab0116c2e22cd4ba (DEFAULT_TABLE table=default.table_4bb4f7811f444da2b0eca6ab9e9203dd [id=aa6cfb171b4c482caa17d7c0862da3d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:24.206578 24490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a27e6c05e40742d4ab0116c2e22cd4ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:24.207739 24312 master_service.cc:965] ReplaceTablet: received request to replace tablet b68f23d363924777ad43e7cbe5981571 from {username='slave'} at 127.0.0.1:41728
I20261120 09:03:24.207933 24934 raft_consensus.cc:744] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 LEADER]: Becoming Leader. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Running, Role: LEADER
I20261120 09:03:24.208294 24934 consensus_queue.cc:238] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.210347 24312 catalog_manager.cc:2551] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41728:
table { table_name: "default.Table_c97aaa8fd7f446ed8008a6bcecc8b494" } modify_external_catalogs: true
I20261120 09:03:24.210630 24312 catalog_manager.cc:2799] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41728:
table { table_name: "default.Table_c97aaa8fd7f446ed8008a6bcecc8b494" } modify_external_catalogs: true
I20261120 09:03:24.213359 24788 tablet_service.cc:1495] Processing CreateTablet for tablet a27e6c05e40742d4ab0116c2e22cd4ba (DEFAULT_TABLE table=default.table_4bb4f7811f444da2b0eca6ab9e9203dd [id=aa6cfb171b4c482caa17d7c0862da3d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:24.214804 24919 raft_consensus.cc:392] T e7f41973f62a48cf8b20ec4d965bfa6e P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:24.214962 24919 raft_consensus.cc:787] T e7f41973f62a48cf8b20ec4d965bfa6e P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Initialized, Role: FOLLOWER
I20261120 09:03:24.215490 24969 leader_election.cc:290] T 75e156478a8a470ba5f4942cd8e6a89e P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:24.215925 24919 consensus_queue.cc:261] T e7f41973f62a48cf8b20ec4d965bfa6e P 2fb9ff0dc3d849d7bcf95806233d2c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:24.216614 24919 ts_tablet_manager.cc:1480] T e7f41973f62a48cf8b20ec4d965bfa6e P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent starting tablet: real 0.028s	user 0.001s	sys 0.001s
I20261120 09:03:24.217902 24661 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "75e156478a8a470ba5f4942cd8e6a89e" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" is_pre_election: true
I20261120 09:03:24.218448 24661 raft_consensus.cc:2062] T 75e156478a8a470ba5f4942cd8e6a89e P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 0
I20261120 09:03:24.218691 24919 tablet_bootstrap.cc:492] T a8cf83af75c745dc96cb98f99cd2335d P 2fb9ff0dc3d849d7bcf95806233d2c62: Bootstrap starting.
I20261120 09:03:24.218775 24788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a27e6c05e40742d4ab0116c2e22cd4ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:24.220937 24642 tablet_service.cc:1542] Processing DeleteTablet for tablet bb6d14de3cb9421987fb9eeb16fbd199 with delete_type TABLET_DATA_DELETED (replaced by tablet 8732692e59194cdabba0578275da133b) from {username='slave'} at 127.0.0.1:40170
I20261120 09:03:24.221354 24929 tablet_replica.cc:333] T bb6d14de3cb9421987fb9eeb16fbd199 P 2fb9ff0dc3d849d7bcf95806233d2c62: stopping tablet replica
I20261120 09:03:24.221504 24929 raft_consensus.cc:2440] T bb6d14de3cb9421987fb9eeb16fbd199 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Raft consensus shutting down.
I20261120 09:03:24.221647 24929 raft_consensus.cc:2469] T bb6d14de3cb9421987fb9eeb16fbd199 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Raft consensus is shut down!
I20261120 09:03:24.222092 24929 ts_tablet_manager.cc:1962] T bb6d14de3cb9421987fb9eeb16fbd199 P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261120 09:03:24.204623 24918 raft_consensus.cc:366] T a8cf83af75c745dc96cb98f99cd2335d P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.225419 24918 raft_consensus.cc:392] T a8cf83af75c745dc96cb98f99cd2335d P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:24.225533 24918 raft_consensus.cc:787] T a8cf83af75c745dc96cb98f99cd2335d P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Initialized, Role: FOLLOWER
I20261120 09:03:24.226457 24639 tablet_service.cc:1542] Processing DeleteTablet for tablet aa0f46d52f9b4608ba87baf575d59f89 with delete_type TABLET_DATA_DELETED (replaced by tablet a27e6c05e40742d4ab0116c2e22cd4ba) from {username='slave'} at 127.0.0.1:40170
I20261120 09:03:24.226511 24918 consensus_queue.cc:261] T a8cf83af75c745dc96cb98f99cd2335d P 8668dad23e404dafb0ac25267f07bd46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.226799 24640 tablet_service.cc:1495] Processing CreateTablet for tablet 8732692e59194cdabba0578275da133b (DEFAULT_TABLE table=default.table_44e6e9d80f3244618eb164246f389566 [id=cb55967ea90e43be8da1354763f7984c]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:24.228086 24640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8732692e59194cdabba0578275da133b. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:24.231228 24639 tablet_service.cc:1495] Processing CreateTablet for tablet a27e6c05e40742d4ab0116c2e22cd4ba (DEFAULT_TABLE table=default.table_4bb4f7811f444da2b0eca6ab9e9203dd [id=aa6cfb171b4c482caa17d7c0862da3d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:24.232339 24639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a27e6c05e40742d4ab0116c2e22cd4ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:24.233489 24918 ts_tablet_manager.cc:1480] T a8cf83af75c745dc96cb98f99cd2335d P 8668dad23e404dafb0ac25267f07bd46: Time spent starting tablet: real 0.029s	user 0.000s	sys 0.002s
I20261120 09:03:24.236745 24919 tablet_bootstrap.cc:654] T a8cf83af75c745dc96cb98f99cd2335d P 2fb9ff0dc3d849d7bcf95806233d2c62: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:24.237567 24918 tablet_bootstrap.cc:492] T a48b8166531548208bf3ae77f7380555 P 8668dad23e404dafb0ac25267f07bd46: Bootstrap starting.
I20261120 09:03:24.239826 24918 tablet_bootstrap.cc:654] T a48b8166531548208bf3ae77f7380555 P 8668dad23e404dafb0ac25267f07bd46: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:24.240675 24980 raft_consensus.cc:556] T 75e156478a8a470ba5f4942cd8e6a89e P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.241914 24661 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "75e156478a8a470ba5f4942cd8e6a89e" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62"
I20261120 09:03:24.242103 24661 raft_consensus.cc:3296] T 75e156478a8a470ba5f4942cd8e6a89e P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.245615 24929 ts_tablet_manager.cc:1975] T bb6d14de3cb9421987fb9eeb16fbd199 P 2fb9ff0dc3d849d7bcf95806233d2c62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20261120 09:03:24.245761 24929 log.cc:1199] T bb6d14de3cb9421987fb9eeb16fbd199 P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-1/wal/wals/bb6d14de3cb9421987fb9eeb16fbd199
I20261120 09:03:24.246205 24929 ts_tablet_manager.cc:1996] T bb6d14de3cb9421987fb9eeb16fbd199 P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting consensus metadata
I20261120 09:03:24.246616 24920 tablet_bootstrap.cc:492] T 707757cc32af4fe98d4a04e6a7498c17 P 2c3fe57b9d2c424da181281af303f3c3: No bootstrap required, opened a new log
I20261120 09:03:24.246814 24920 ts_tablet_manager.cc:1449] T 707757cc32af4fe98d4a04e6a7498c17 P 2c3fe57b9d2c424da181281af303f3c3: Time spent bootstrapping tablet: real 0.054s	user 0.005s	sys 0.001s
I20261120 09:03:24.247938 24920 raft_consensus.cc:366] T 707757cc32af4fe98d4a04e6a7498c17 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } }
I20261120 09:03:24.248170 24920 raft_consensus.cc:392] T 707757cc32af4fe98d4a04e6a7498c17 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:24.248307 24920 raft_consensus.cc:787] T 707757cc32af4fe98d4a04e6a7498c17 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Initialized, Role: FOLLOWER
I20261120 09:03:24.248697 24920 consensus_queue.cc:261] T 707757cc32af4fe98d4a04e6a7498c17 P 2c3fe57b9d2c424da181281af303f3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } }
I20261120 09:03:24.249059 24808 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "75e156478a8a470ba5f4942cd8e6a89e" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46"
I20261120 09:03:24.249258 24808 raft_consensus.cc:3296] T 75e156478a8a470ba5f4942cd8e6a89e P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.249527 24808 raft_consensus.cc:2062] T 75e156478a8a470ba5f4942cd8e6a89e P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 1
I20261120 09:03:24.251922 24307 catalog_manager.cc:5081] TS 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): tablet bb6d14de3cb9421987fb9eeb16fbd199 (table default.table_44e6e9d80f3244618eb164246f389566 [id=cb55967ea90e43be8da1354763f7984c]) successfully deleted
I20261120 09:03:24.252978 24919 tablet_bootstrap.cc:492] T a8cf83af75c745dc96cb98f99cd2335d P 2fb9ff0dc3d849d7bcf95806233d2c62: No bootstrap required, opened a new log
I20261120 09:03:24.253134 24919 ts_tablet_manager.cc:1449] T a8cf83af75c745dc96cb98f99cd2335d P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent bootstrapping tablet: real 0.036s	user 0.002s	sys 0.003s
I20261120 09:03:24.253283 24661 raft_consensus.cc:2062] T 75e156478a8a470ba5f4942cd8e6a89e P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 1
I20261120 09:03:24.253587 24920 ts_tablet_manager.cc:1480] T 707757cc32af4fe98d4a04e6a7498c17 P 2c3fe57b9d2c424da181281af303f3c3: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.003s
I20261120 09:03:24.254282 24919 raft_consensus.cc:366] T a8cf83af75c745dc96cb98f99cd2335d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.254439 24919 raft_consensus.cc:392] T a8cf83af75c745dc96cb98f99cd2335d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:24.254495 24443 leader_election.cc:304] T 75e156478a8a470ba5f4942cd8e6a89e P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46; no voters: 
I20261120 09:03:24.254575 24919 raft_consensus.cc:787] T a8cf83af75c745dc96cb98f99cd2335d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Initialized, Role: FOLLOWER
I20261120 09:03:24.254768 24980 leader_election.cc:290] T 75e156478a8a470ba5f4942cd8e6a89e P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 election: Requested vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:24.254812 24920 tablet_bootstrap.cc:492] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3: Bootstrap starting.
I20261120 09:03:24.255023 24980 raft_consensus.cc:3024] T 75e156478a8a470ba5f4942cd8e6a89e P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Leader election won for term 1
I20261120 09:03:24.254894 24919 consensus_queue.cc:261] T a8cf83af75c745dc96cb98f99cd2335d P 2fb9ff0dc3d849d7bcf95806233d2c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.255162 24980 raft_consensus.cc:744] T 75e156478a8a470ba5f4942cd8e6a89e P 2c3fe57b9d2c424da181281af303f3c3 [term 1 LEADER]: Becoming Leader. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Running, Role: LEADER
I20261120 09:03:24.255441 24929 tablet_replica.cc:333] T aa0f46d52f9b4608ba87baf575d59f89 P 2fb9ff0dc3d849d7bcf95806233d2c62: stopping tablet replica
I20261120 09:03:24.255472 24980 consensus_queue.cc:238] T 75e156478a8a470ba5f4942cd8e6a89e P 2c3fe57b9d2c424da181281af303f3c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.257632 24974 raft_consensus.cc:534] T be76b618f4f142849d785428cd83c0f5 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:24.257834 24974 raft_consensus.cc:556] T be76b618f4f142849d785428cd83c0f5 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.259244 24974 leader_election.cc:290] T be76b618f4f142849d785428cd83c0f5 P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:24.259351 24809 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "be76b618f4f142849d785428cd83c0f5" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46" is_pre_election: true
I20261120 09:03:24.259789 24660 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "be76b618f4f142849d785428cd83c0f5" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" is_pre_election: true
W20261120 09:03:24.259995 24443 leader_election.cc:343] T be76b618f4f142849d785428cd83c0f5 P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Illegal state: must be running to vote when last-logged opid is not known
W20261120 09:03:24.260607 24445 leader_election.cc:343] T be76b618f4f142849d785428cd83c0f5 P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): Illegal state: must be running to vote when last-logged opid is not known
I20261120 09:03:24.260720 24445 leader_election.cc:304] T be76b618f4f142849d785428cd83c0f5 P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3; no voters: 2fb9ff0dc3d849d7bcf95806233d2c62, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:03:24.261803 24930 raft_consensus.cc:2440] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 LEADER]: Raft consensus shutting down.
I20261120 09:03:24.262470 24930 pending_rounds.cc:70] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3: Trying to abort 1 pending ops.
I20261120 09:03:24.262590 24969 raft_consensus.cc:2966] T be76b618f4f142849d785428cd83c0f5 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:03:24.262694 24930 pending_rounds.cc:77] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7352997495640666112 op_type: NO_OP noop_request { }
I20261120 09:03:24.262809 24930 raft_consensus.cc:3115] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20261120 09:03:24.262934 24930 raft_consensus.cc:2469] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261120 09:03:24.263592 24969 raft_consensus.cc:534] T e7f41973f62a48cf8b20ec4d965bfa6e P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:24.263717 24969 raft_consensus.cc:556] T e7f41973f62a48cf8b20ec4d965bfa6e P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:24.263940 24920 tablet_bootstrap.cc:654] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:24.264564 24660 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "e7f41973f62a48cf8b20ec4d965bfa6e" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" is_pre_election: true
I20261120 09:03:24.264735 24930 ts_tablet_manager.cc:1962] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261120 09:03:24.264776 24660 raft_consensus.cc:2062] T e7f41973f62a48cf8b20ec4d965bfa6e P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 0
I20261120 09:03:24.265105 24445 leader_election.cc:304] T e7f41973f62a48cf8b20ec4d965bfa6e P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 
I20261120 09:03:24.265516 24934 raft_consensus.cc:3024] T e7f41973f62a48cf8b20ec4d965bfa6e P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261120 09:03:24.265618 24934 raft_consensus.cc:534] T e7f41973f62a48cf8b20ec4d965bfa6e P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261120 09:03:24.265735 24934 raft_consensus.cc:3296] T e7f41973f62a48cf8b20ec4d965bfa6e P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.266001 24934 raft_consensus.cc:556] T e7f41973f62a48cf8b20ec4d965bfa6e P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:24.266573 24969 leader_election.cc:290] T e7f41973f62a48cf8b20ec4d965bfa6e P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:24.267541 24979 consensus_queue.cc:1049] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:24.268110 24809 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "e7f41973f62a48cf8b20ec4d965bfa6e" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46" is_pre_election: true
I20261120 09:03:24.268355 24809 raft_consensus.cc:2062] T e7f41973f62a48cf8b20ec4d965bfa6e P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 0
I20261120 09:03:24.270139 24660 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "e7f41973f62a48cf8b20ec4d965bfa6e" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62"
I20261120 09:03:24.270330 24660 raft_consensus.cc:3296] T e7f41973f62a48cf8b20ec4d965bfa6e P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.270694 24660 raft_consensus.cc:2062] T e7f41973f62a48cf8b20ec4d965bfa6e P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 1
I20261120 09:03:24.270987 24934 leader_election.cc:290] T e7f41973f62a48cf8b20ec4d965bfa6e P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 election: Requested vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:24.273895 24980 consensus_queue.cc:1049] T 75e156478a8a470ba5f4942cd8e6a89e P 2c3fe57b9d2c424da181281af303f3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:24.273972 24930 ts_tablet_manager.cc:1975] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20261120 09:03:24.274179 24930 log.cc:1199] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-0/wal/wals/fa8252fc6fee4aa7b20b53a08623e358
I20261120 09:03:24.274641 24930 ts_tablet_manager.cc:1996] T fa8252fc6fee4aa7b20b53a08623e358 P 2c3fe57b9d2c424da181281af303f3c3: Deleting consensus metadata
I20261120 09:03:24.275913 24305 catalog_manager.cc:5081] TS 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): tablet fa8252fc6fee4aa7b20b53a08623e358 (table default.table_eb77729285254174a498bb17a0adceea [id=90570e46cebe47eba97e5b980f23e909]) successfully deleted
I20261120 09:03:24.276353 24930 tablet_replica.cc:333] T bb6d14de3cb9421987fb9eeb16fbd199 P 2c3fe57b9d2c424da181281af303f3c3: stopping tablet replica
I20261120 09:03:24.276666 24930 raft_consensus.cc:2440] T bb6d14de3cb9421987fb9eeb16fbd199 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20261120 09:03:24.276872 24930 raft_consensus.cc:2469] T bb6d14de3cb9421987fb9eeb16fbd199 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20261120 09:03:24.277527 24930 ts_tablet_manager.cc:1962] T bb6d14de3cb9421987fb9eeb16fbd199 P 2c3fe57b9d2c424da181281af303f3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261120 09:03:24.277433 24933 consensus_queue.cc:1049] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:24.277290 24807 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "e7f41973f62a48cf8b20ec4d965bfa6e" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46"
I20261120 09:03:24.277820 24807 raft_consensus.cc:3296] T e7f41973f62a48cf8b20ec4d965bfa6e P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.280230 24807 raft_consensus.cc:2062] T e7f41973f62a48cf8b20ec4d965bfa6e P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 1
I20261120 09:03:24.281679 24974 consensus_queue.cc:1049] T 75e156478a8a470ba5f4942cd8e6a89e P 2c3fe57b9d2c424da181281af303f3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:24.286015 24919 ts_tablet_manager.cc:1480] T a8cf83af75c745dc96cb98f99cd2335d P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.001s
I20261120 09:03:24.286732 24443 leader_election.cc:304] T e7f41973f62a48cf8b20ec4d965bfa6e P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46; no voters: 
I20261120 09:03:24.288089 24919 tablet_bootstrap.cc:492] T be76b618f4f142849d785428cd83c0f5 P 2fb9ff0dc3d849d7bcf95806233d2c62: Bootstrap starting.
I20261120 09:03:24.288316 24986 raft_consensus.cc:3024] T e7f41973f62a48cf8b20ec4d965bfa6e P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Leader election won for term 1
I20261120 09:03:24.288658 24986 raft_consensus.cc:744] T e7f41973f62a48cf8b20ec4d965bfa6e P 2c3fe57b9d2c424da181281af303f3c3 [term 1 LEADER]: Becoming Leader. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Running, Role: LEADER
I20261120 09:03:24.289005 24986 consensus_queue.cc:238] T e7f41973f62a48cf8b20ec4d965bfa6e P 2c3fe57b9d2c424da181281af303f3c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:24.289813 24919 tablet_bootstrap.cc:654] T be76b618f4f142849d785428cd83c0f5 P 2fb9ff0dc3d849d7bcf95806233d2c62: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:24.294915 24929 raft_consensus.cc:2440] T aa0f46d52f9b4608ba87baf575d59f89 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Raft consensus shutting down.
W20261120 09:03:24.296612 24978 raft_consensus.cc:717] T aa0f46d52f9b4608ba87baf575d59f89 P 2fb9ff0dc3d849d7bcf95806233d2c62: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
I20261120 09:03:24.299791 24929 pending_rounds.cc:70] T aa0f46d52f9b4608ba87baf575d59f89 P 2fb9ff0dc3d849d7bcf95806233d2c62: Trying to abort 1 pending ops.
I20261120 09:03:24.299993 24929 pending_rounds.cc:77] T aa0f46d52f9b4608ba87baf575d59f89 P 2fb9ff0dc3d849d7bcf95806233d2c62: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7352997494787596288 op_type: NO_OP noop_request { }
I20261120 09:03:24.300140 24929 raft_consensus.cc:3115] T aa0f46d52f9b4608ba87baf575d59f89 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20261120 09:03:24.300315 24929 raft_consensus.cc:2469] T aa0f46d52f9b4608ba87baf575d59f89 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Raft consensus is shut down!
W20261120 09:03:24.307271 24445 consensus_peers.cc:597] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3 -> Peer 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): Couldn't send request to peer 2fb9ff0dc3d849d7bcf95806233d2c62. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20261120 09:03:24.310843 24934 consensus_queue.cc:1049] T e7f41973f62a48cf8b20ec4d965bfa6e P 2c3fe57b9d2c424da181281af303f3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:24.314648 24934 consensus_queue.cc:1049] T e7f41973f62a48cf8b20ec4d965bfa6e P 2c3fe57b9d2c424da181281af303f3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:24.323469 24929 ts_tablet_manager.cc:1962] T aa0f46d52f9b4608ba87baf575d59f89 P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261120 09:03:24.328923 24920 tablet_bootstrap.cc:492] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3: No bootstrap required, opened a new log
I20261120 09:03:24.329097 24920 ts_tablet_manager.cc:1449] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3: Time spent bootstrapping tablet: real 0.075s	user 0.002s	sys 0.005s
I20261120 09:03:24.329777 24920 raft_consensus.cc:366] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.329969 24920 raft_consensus.cc:392] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:24.330052 24920 raft_consensus.cc:787] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Initialized, Role: FOLLOWER
I20261120 09:03:24.330300 24920 consensus_queue.cc:261] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.332952 24920 ts_tablet_manager.cc:1480] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.001s
I20261120 09:03:24.335199 24920 tablet_bootstrap.cc:492] T a27e6c05e40742d4ab0116c2e22cd4ba P 2c3fe57b9d2c424da181281af303f3c3: Bootstrap starting.
I20261120 09:03:24.335302 24928 ts_tablet_manager.cc:1975] T bb6d14de3cb9421987fb9eeb16fbd199 P 8668dad23e404dafb0ac25267f07bd46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20261120 09:03:24.335489 24928 log.cc:1199] T bb6d14de3cb9421987fb9eeb16fbd199 P 8668dad23e404dafb0ac25267f07bd46: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-2/wal/wals/bb6d14de3cb9421987fb9eeb16fbd199
I20261120 09:03:24.335950 24928 ts_tablet_manager.cc:1996] T bb6d14de3cb9421987fb9eeb16fbd199 P 8668dad23e404dafb0ac25267f07bd46: Deleting consensus metadata
I20261120 09:03:24.336903 24928 tablet_replica.cc:333] T aa0f46d52f9b4608ba87baf575d59f89 P 8668dad23e404dafb0ac25267f07bd46: stopping tablet replica
I20261120 09:03:24.337109 24305 catalog_manager.cc:5081] TS 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): tablet bb6d14de3cb9421987fb9eeb16fbd199 (table default.table_44e6e9d80f3244618eb164246f389566 [id=cb55967ea90e43be8da1354763f7984c]) successfully deleted
I20261120 09:03:24.337185 24928 raft_consensus.cc:2440] T aa0f46d52f9b4608ba87baf575d59f89 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20261120 09:03:24.337448 24928 raft_consensus.cc:2469] T aa0f46d52f9b4608ba87baf575d59f89 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261120 09:03:24.339723 24918 tablet_bootstrap.cc:492] T a48b8166531548208bf3ae77f7380555 P 8668dad23e404dafb0ac25267f07bd46: No bootstrap required, opened a new log
I20261120 09:03:24.339915 24918 ts_tablet_manager.cc:1449] T a48b8166531548208bf3ae77f7380555 P 8668dad23e404dafb0ac25267f07bd46: Time spent bootstrapping tablet: real 0.102s	user 0.000s	sys 0.004s
I20261120 09:03:24.340502 24918 raft_consensus.cc:366] T a48b8166531548208bf3ae77f7380555 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.340672 24918 raft_consensus.cc:392] T a48b8166531548208bf3ae77f7380555 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:24.340756 24918 raft_consensus.cc:787] T a48b8166531548208bf3ae77f7380555 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Initialized, Role: FOLLOWER
I20261120 09:03:24.341025 24918 consensus_queue.cc:261] T a48b8166531548208bf3ae77f7380555 P 8668dad23e404dafb0ac25267f07bd46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.341504 24918 ts_tablet_manager.cc:1480] T a48b8166531548208bf3ae77f7380555 P 8668dad23e404dafb0ac25267f07bd46: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20261120 09:03:24.341914 24928 ts_tablet_manager.cc:1962] T aa0f46d52f9b4608ba87baf575d59f89 P 8668dad23e404dafb0ac25267f07bd46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261120 09:03:24.342445 24918 tablet_bootstrap.cc:492] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46: Bootstrap starting.
I20261120 09:03:24.344292 24918 tablet_bootstrap.cc:654] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:24.347436 24920 tablet_bootstrap.cc:654] T a27e6c05e40742d4ab0116c2e22cd4ba P 2c3fe57b9d2c424da181281af303f3c3: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:24.352774 24930 ts_tablet_manager.cc:1975] T bb6d14de3cb9421987fb9eeb16fbd199 P 2c3fe57b9d2c424da181281af303f3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20261120 09:03:24.352916 24930 log.cc:1199] T bb6d14de3cb9421987fb9eeb16fbd199 P 2c3fe57b9d2c424da181281af303f3c3: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-0/wal/wals/bb6d14de3cb9421987fb9eeb16fbd199
I20261120 09:03:24.353844 24919 tablet_bootstrap.cc:492] T be76b618f4f142849d785428cd83c0f5 P 2fb9ff0dc3d849d7bcf95806233d2c62: No bootstrap required, opened a new log
I20261120 09:03:24.354001 24919 ts_tablet_manager.cc:1449] T be76b618f4f142849d785428cd83c0f5 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent bootstrapping tablet: real 0.066s	user 0.006s	sys 0.000s
I20261120 09:03:24.354799 24919 raft_consensus.cc:366] T be76b618f4f142849d785428cd83c0f5 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.354988 24919 raft_consensus.cc:392] T be76b618f4f142849d785428cd83c0f5 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:24.355064 24919 raft_consensus.cc:787] T be76b618f4f142849d785428cd83c0f5 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Initialized, Role: FOLLOWER
I20261120 09:03:24.355298 24919 consensus_queue.cc:261] T be76b618f4f142849d785428cd83c0f5 P 2fb9ff0dc3d849d7bcf95806233d2c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.355803 24919 ts_tablet_manager.cc:1480] T be76b618f4f142849d785428cd83c0f5 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.000s
I20261120 09:03:24.356094 24919 tablet_bootstrap.cc:492] T a48b8166531548208bf3ae77f7380555 P 2fb9ff0dc3d849d7bcf95806233d2c62: Bootstrap starting.
I20261120 09:03:24.357805 24919 tablet_bootstrap.cc:654] T a48b8166531548208bf3ae77f7380555 P 2fb9ff0dc3d849d7bcf95806233d2c62: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:24.359993 24930 ts_tablet_manager.cc:1996] T bb6d14de3cb9421987fb9eeb16fbd199 P 2c3fe57b9d2c424da181281af303f3c3: Deleting consensus metadata
I20261120 09:03:24.361088 24305 catalog_manager.cc:5081] TS 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): tablet bb6d14de3cb9421987fb9eeb16fbd199 (table default.table_44e6e9d80f3244618eb164246f389566 [id=cb55967ea90e43be8da1354763f7984c]) successfully deleted
I20261120 09:03:24.361512 24930 tablet_replica.cc:333] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3: stopping tablet replica
I20261120 09:03:24.361699 24930 raft_consensus.cc:2440] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 LEADER]: Raft consensus shutting down.
I20261120 09:03:24.362118 24930 raft_consensus.cc:2469] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261120 09:03:24.364369 24919 tablet_bootstrap.cc:492] T a48b8166531548208bf3ae77f7380555 P 2fb9ff0dc3d849d7bcf95806233d2c62: No bootstrap required, opened a new log
I20261120 09:03:24.364522 24919 ts_tablet_manager.cc:1449] T a48b8166531548208bf3ae77f7380555 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent bootstrapping tablet: real 0.009s	user 0.004s	sys 0.000s
I20261120 09:03:24.365309 24919 raft_consensus.cc:366] T a48b8166531548208bf3ae77f7380555 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.365494 24919 raft_consensus.cc:392] T a48b8166531548208bf3ae77f7380555 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:24.365592 24919 raft_consensus.cc:787] T a48b8166531548208bf3ae77f7380555 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Initialized, Role: FOLLOWER
I20261120 09:03:24.365832 24919 consensus_queue.cc:261] T a48b8166531548208bf3ae77f7380555 P 2fb9ff0dc3d849d7bcf95806233d2c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.369184 24986 raft_consensus.cc:534] T 707757cc32af4fe98d4a04e6a7498c17 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:24.369356 24986 raft_consensus.cc:556] T 707757cc32af4fe98d4a04e6a7498c17 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } }
I20261120 09:03:24.370365 24809 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "707757cc32af4fe98d4a04e6a7498c17" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46" is_pre_election: true
W20261120 09:03:24.370939 24443 leader_election.cc:343] T 707757cc32af4fe98d4a04e6a7498c17 P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Illegal state: must be running to vote when last-logged opid is not known
I20261120 09:03:24.371620 24986 leader_election.cc:290] T 707757cc32af4fe98d4a04e6a7498c17 P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879)
I20261120 09:03:24.371819 24920 tablet_bootstrap.cc:492] T a27e6c05e40742d4ab0116c2e22cd4ba P 2c3fe57b9d2c424da181281af303f3c3: No bootstrap required, opened a new log
I20261120 09:03:24.371852 24661 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "707757cc32af4fe98d4a04e6a7498c17" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" is_pre_election: true
I20261120 09:03:24.372038 24920 ts_tablet_manager.cc:1449] T a27e6c05e40742d4ab0116c2e22cd4ba P 2c3fe57b9d2c424da181281af303f3c3: Time spent bootstrapping tablet: real 0.037s	user 0.001s	sys 0.003s
W20261120 09:03:24.372352 24445 leader_election.cc:343] T 707757cc32af4fe98d4a04e6a7498c17 P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): Illegal state: must be running to vote when last-logged opid is not known
I20261120 09:03:24.372471 24445 leader_election.cc:304] T 707757cc32af4fe98d4a04e6a7498c17 P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3; no voters: 2fb9ff0dc3d849d7bcf95806233d2c62, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:03:24.372888 24986 raft_consensus.cc:2966] T 707757cc32af4fe98d4a04e6a7498c17 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:03:24.372864 24920 raft_consensus.cc:366] T a27e6c05e40742d4ab0116c2e22cd4ba P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.373271 24919 ts_tablet_manager.cc:1480] T a48b8166531548208bf3ae77f7380555 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.000s
I20261120 09:03:24.373315 24920 raft_consensus.cc:392] T a27e6c05e40742d4ab0116c2e22cd4ba P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:24.373406 24920 raft_consensus.cc:787] T a27e6c05e40742d4ab0116c2e22cd4ba P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Initialized, Role: FOLLOWER
I20261120 09:03:24.373629 24920 consensus_queue.cc:261] T a27e6c05e40742d4ab0116c2e22cd4ba P 2c3fe57b9d2c424da181281af303f3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.376240 24919 tablet_bootstrap.cc:492] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2fb9ff0dc3d849d7bcf95806233d2c62: Bootstrap starting.
I20261120 09:03:24.376633 24920 ts_tablet_manager.cc:1480] T a27e6c05e40742d4ab0116c2e22cd4ba P 2c3fe57b9d2c424da181281af303f3c3: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.001s
I20261120 09:03:24.378013 24919 tablet_bootstrap.cc:654] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2fb9ff0dc3d849d7bcf95806233d2c62: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:24.363415 24930 ts_tablet_manager.cc:1962] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261120 09:03:24.382951 24928 ts_tablet_manager.cc:1975] T aa0f46d52f9b4608ba87baf575d59f89 P 8668dad23e404dafb0ac25267f07bd46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20261120 09:03:24.383141 24928 log.cc:1199] T aa0f46d52f9b4608ba87baf575d59f89 P 8668dad23e404dafb0ac25267f07bd46: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-2/wal/wals/aa0f46d52f9b4608ba87baf575d59f89
I20261120 09:03:24.383633 24928 ts_tablet_manager.cc:1996] T aa0f46d52f9b4608ba87baf575d59f89 P 8668dad23e404dafb0ac25267f07bd46: Deleting consensus metadata
I20261120 09:03:24.378057 24929 ts_tablet_manager.cc:1975] T aa0f46d52f9b4608ba87baf575d59f89 P 2fb9ff0dc3d849d7bcf95806233d2c62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20261120 09:03:24.383924 24929 log.cc:1199] T aa0f46d52f9b4608ba87baf575d59f89 P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-1/wal/wals/aa0f46d52f9b4608ba87baf575d59f89
I20261120 09:03:24.384403 24929 ts_tablet_manager.cc:1996] T aa0f46d52f9b4608ba87baf575d59f89 P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting consensus metadata
I20261120 09:03:24.384862 24305 catalog_manager.cc:5081] TS 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): tablet aa0f46d52f9b4608ba87baf575d59f89 (table default.table_4bb4f7811f444da2b0eca6ab9e9203dd [id=aa6cfb171b4c482caa17d7c0862da3d0]) successfully deleted
I20261120 09:03:24.384574 24918 tablet_bootstrap.cc:492] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46: No bootstrap required, opened a new log
I20261120 09:03:24.385217 24918 ts_tablet_manager.cc:1449] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46: Time spent bootstrapping tablet: real 0.043s	user 0.004s	sys 0.000s
I20261120 09:03:24.385260 24930 ts_tablet_manager.cc:1975] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20261120 09:03:24.385362 24930 log.cc:1199] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-0/wal/wals/aa0f46d52f9b4608ba87baf575d59f89
I20261120 09:03:24.385720 24930 ts_tablet_manager.cc:1996] T aa0f46d52f9b4608ba87baf575d59f89 P 2c3fe57b9d2c424da181281af303f3c3: Deleting consensus metadata
I20261120 09:03:24.386634 24305 catalog_manager.cc:5081] TS 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): tablet aa0f46d52f9b4608ba87baf575d59f89 (table default.table_4bb4f7811f444da2b0eca6ab9e9203dd [id=aa6cfb171b4c482caa17d7c0862da3d0]) successfully deleted
I20261120 09:03:24.387588 24918 raft_consensus.cc:366] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.387847 24919 tablet_bootstrap.cc:492] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2fb9ff0dc3d849d7bcf95806233d2c62: No bootstrap required, opened a new log
I20261120 09:03:24.388008 24919 ts_tablet_manager.cc:1449] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent bootstrapping tablet: real 0.012s	user 0.001s	sys 0.002s
I20261120 09:03:24.388799 24919 raft_consensus.cc:366] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:24.388890 24307 catalog_manager.cc:5081] TS 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): tablet aa0f46d52f9b4608ba87baf575d59f89 (table default.table_4bb4f7811f444da2b0eca6ab9e9203dd [id=aa6cfb171b4c482caa17d7c0862da3d0]) successfully deleted
I20261120 09:03:24.389029 24919 raft_consensus.cc:392] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:24.389099 24919 raft_consensus.cc:787] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Initialized, Role: FOLLOWER
I20261120 09:03:24.389386 24919 consensus_queue.cc:261] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2fb9ff0dc3d849d7bcf95806233d2c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:24.392827 24919 ts_tablet_manager.cc:1480] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.001s
I20261120 09:03:24.395450 24918 raft_consensus.cc:392] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:24.395629 24918 raft_consensus.cc:787] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Initialized, Role: FOLLOWER
I20261120 09:03:24.395888 24919 tablet_bootstrap.cc:492] T a27e6c05e40742d4ab0116c2e22cd4ba P 2fb9ff0dc3d849d7bcf95806233d2c62: Bootstrap starting.
I20261120 09:03:24.396023 24918 consensus_queue.cc:261] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.397719 24919 tablet_bootstrap.cc:654] T a27e6c05e40742d4ab0116c2e22cd4ba P 2fb9ff0dc3d849d7bcf95806233d2c62: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:24.402577 24918 ts_tablet_manager.cc:1480] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46: Time spent starting tablet: real 0.016s	user 0.001s	sys 0.001s
I20261120 09:03:24.406616 24918 tablet_bootstrap.cc:492] T 8155295b7e8e40ddaedeb2e9c24f1245 P 8668dad23e404dafb0ac25267f07bd46: Bootstrap starting.
I20261120 09:03:24.408550 24918 tablet_bootstrap.cc:654] T 8155295b7e8e40ddaedeb2e9c24f1245 P 8668dad23e404dafb0ac25267f07bd46: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:24.430783 24919 tablet_bootstrap.cc:492] T a27e6c05e40742d4ab0116c2e22cd4ba P 2fb9ff0dc3d849d7bcf95806233d2c62: No bootstrap required, opened a new log
I20261120 09:03:24.431371 24919 ts_tablet_manager.cc:1449] T a27e6c05e40742d4ab0116c2e22cd4ba P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.017s
I20261120 09:03:24.432149 24919 raft_consensus.cc:366] T a27e6c05e40742d4ab0116c2e22cd4ba P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.432399 24919 raft_consensus.cc:392] T a27e6c05e40742d4ab0116c2e22cd4ba P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:24.432514 24919 raft_consensus.cc:787] T a27e6c05e40742d4ab0116c2e22cd4ba P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Initialized, Role: FOLLOWER
I20261120 09:03:24.432814 24919 consensus_queue.cc:261] T a27e6c05e40742d4ab0116c2e22cd4ba P 2fb9ff0dc3d849d7bcf95806233d2c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.436566 24919 ts_tablet_manager.cc:1480] T a27e6c05e40742d4ab0116c2e22cd4ba P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.000s
I20261120 09:03:24.439801 24919 tablet_bootstrap.cc:492] T 8732692e59194cdabba0578275da133b P 2fb9ff0dc3d849d7bcf95806233d2c62: Bootstrap starting.
I20261120 09:03:24.441484 24918 tablet_bootstrap.cc:492] T 8155295b7e8e40ddaedeb2e9c24f1245 P 8668dad23e404dafb0ac25267f07bd46: No bootstrap required, opened a new log
I20261120 09:03:24.441670 24918 ts_tablet_manager.cc:1449] T 8155295b7e8e40ddaedeb2e9c24f1245 P 8668dad23e404dafb0ac25267f07bd46: Time spent bootstrapping tablet: real 0.035s	user 0.002s	sys 0.001s
I20261120 09:03:24.442408 24918 raft_consensus.cc:366] T 8155295b7e8e40ddaedeb2e9c24f1245 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:24.442619 24918 raft_consensus.cc:392] T 8155295b7e8e40ddaedeb2e9c24f1245 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:24.442696 24918 raft_consensus.cc:787] T 8155295b7e8e40ddaedeb2e9c24f1245 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Initialized, Role: FOLLOWER
I20261120 09:03:24.442942 24919 tablet_bootstrap.cc:654] T 8732692e59194cdabba0578275da133b P 2fb9ff0dc3d849d7bcf95806233d2c62: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:24.442968 24918 consensus_queue.cc:261] T 8155295b7e8e40ddaedeb2e9c24f1245 P 8668dad23e404dafb0ac25267f07bd46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:24.443620 24918 ts_tablet_manager.cc:1480] T 8155295b7e8e40ddaedeb2e9c24f1245 P 8668dad23e404dafb0ac25267f07bd46: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
I20261120 09:03:24.443893 24918 tablet_bootstrap.cc:492] T 707757cc32af4fe98d4a04e6a7498c17 P 8668dad23e404dafb0ac25267f07bd46: Bootstrap starting.
I20261120 09:03:24.445581 24918 tablet_bootstrap.cc:654] T 707757cc32af4fe98d4a04e6a7498c17 P 8668dad23e404dafb0ac25267f07bd46: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:24.463234 24918 tablet_bootstrap.cc:492] T 707757cc32af4fe98d4a04e6a7498c17 P 8668dad23e404dafb0ac25267f07bd46: No bootstrap required, opened a new log
I20261120 09:03:24.463414 24918 ts_tablet_manager.cc:1449] T 707757cc32af4fe98d4a04e6a7498c17 P 8668dad23e404dafb0ac25267f07bd46: Time spent bootstrapping tablet: real 0.020s	user 0.001s	sys 0.004s
I20261120 09:03:24.464290 24918 raft_consensus.cc:366] T 707757cc32af4fe98d4a04e6a7498c17 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } }
I20261120 09:03:24.464509 24918 raft_consensus.cc:392] T 707757cc32af4fe98d4a04e6a7498c17 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:24.464612 24918 raft_consensus.cc:787] T 707757cc32af4fe98d4a04e6a7498c17 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Initialized, Role: FOLLOWER
I20261120 09:03:24.464893 24918 consensus_queue.cc:261] T 707757cc32af4fe98d4a04e6a7498c17 P 8668dad23e404dafb0ac25267f07bd46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } }
I20261120 09:03:24.465487 24918 ts_tablet_manager.cc:1480] T 707757cc32af4fe98d4a04e6a7498c17 P 8668dad23e404dafb0ac25267f07bd46: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.000s
I20261120 09:03:24.465871 24918 tablet_bootstrap.cc:492] T 8732692e59194cdabba0578275da133b P 8668dad23e404dafb0ac25267f07bd46: Bootstrap starting.
I20261120 09:03:24.467943 24918 tablet_bootstrap.cc:654] T 8732692e59194cdabba0578275da133b P 8668dad23e404dafb0ac25267f07bd46: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:24.473630 24919 tablet_bootstrap.cc:492] T 8732692e59194cdabba0578275da133b P 2fb9ff0dc3d849d7bcf95806233d2c62: No bootstrap required, opened a new log
I20261120 09:03:24.473857 24919 ts_tablet_manager.cc:1449] T 8732692e59194cdabba0578275da133b P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.005s
I20261120 09:03:24.474804 24919 raft_consensus.cc:366] T 8732692e59194cdabba0578275da133b P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.475025 24919 raft_consensus.cc:392] T 8732692e59194cdabba0578275da133b P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:24.475121 24919 raft_consensus.cc:787] T 8732692e59194cdabba0578275da133b P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Initialized, Role: FOLLOWER
I20261120 09:03:24.475404 24919 consensus_queue.cc:261] T 8732692e59194cdabba0578275da133b P 2fb9ff0dc3d849d7bcf95806233d2c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.475999 24919 ts_tablet_manager.cc:1480] T 8732692e59194cdabba0578275da133b P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.001s
I20261120 09:03:24.482879 24919 tablet_bootstrap.cc:492] T 707757cc32af4fe98d4a04e6a7498c17 P 2fb9ff0dc3d849d7bcf95806233d2c62: Bootstrap starting.
I20261120 09:03:24.484942 24919 tablet_bootstrap.cc:654] T 707757cc32af4fe98d4a04e6a7498c17 P 2fb9ff0dc3d849d7bcf95806233d2c62: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:24.488345 24999 raft_consensus.cc:534] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:24.488511 24999 raft_consensus.cc:556] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.489400 24999 leader_election.cc:290] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:24.490218 24510 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "be76b618f4f142849d785428cd83c0f5" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3" is_pre_election: true
I20261120 09:03:24.490489 24510 raft_consensus.cc:2062] T be76b618f4f142849d785428cd83c0f5 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 8668dad23e404dafb0ac25267f07bd46 in term 0
I20261120 09:03:24.491204 24742 leader_election.cc:304] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46; no voters: 
I20261120 09:03:24.491873 24990 raft_consensus.cc:534] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:24.491923 24661 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "be76b618f4f142849d785428cd83c0f5" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" is_pre_election: true
I20261120 09:03:24.492017 24990 raft_consensus.cc:556] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:24.492117 24661 raft_consensus.cc:2062] T be76b618f4f142849d785428cd83c0f5 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 8668dad23e404dafb0ac25267f07bd46 in term 0
I20261120 09:03:24.492568 24990 leader_election.cc:290] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:24.493484 24809 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "8155295b7e8e40ddaedeb2e9c24f1245" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46" is_pre_election: true
I20261120 09:03:24.493691 24809 raft_consensus.cc:2062] T 8155295b7e8e40ddaedeb2e9c24f1245 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 2fb9ff0dc3d849d7bcf95806233d2c62 in term 0
I20261120 09:03:24.494199 24595 leader_election.cc:304] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62, 8668dad23e404dafb0ac25267f07bd46; no voters: 
I20261120 09:03:24.494632 24510 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "8155295b7e8e40ddaedeb2e9c24f1245" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3" is_pre_election: true
I20261120 09:03:24.494889 24510 raft_consensus.cc:2062] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 2fb9ff0dc3d849d7bcf95806233d2c62 in term 0
I20261120 09:03:24.495885 24990 raft_consensus.cc:3024] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261120 09:03:24.496007 24990 raft_consensus.cc:534] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261120 09:03:24.496089 24990 raft_consensus.cc:3296] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.496423 24990 raft_consensus.cc:556] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:24.498710 24999 raft_consensus.cc:3024] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261120 09:03:24.498852 24999 raft_consensus.cc:534] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261120 09:03:24.498950 24999 raft_consensus.cc:3296] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.499276 24999 raft_consensus.cc:556] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.503588 24990 leader_election.cc:290] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 election: Requested vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:24.504655 24809 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "8155295b7e8e40ddaedeb2e9c24f1245" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46"
I20261120 09:03:24.504846 24809 raft_consensus.cc:3296] T 8155295b7e8e40ddaedeb2e9c24f1245 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.505152 24809 raft_consensus.cc:2062] T 8155295b7e8e40ddaedeb2e9c24f1245 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 2fb9ff0dc3d849d7bcf95806233d2c62 in term 1
I20261120 09:03:24.505437 24510 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "8155295b7e8e40ddaedeb2e9c24f1245" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3"
I20261120 09:03:24.505625 24510 raft_consensus.cc:3296] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.505918 24510 raft_consensus.cc:2062] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 2fb9ff0dc3d849d7bcf95806233d2c62 in term 1
I20261120 09:03:24.508992 24595 leader_election.cc:304] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 
I20261120 09:03:24.509699 24999 leader_election.cc:290] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 election: Requested vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:24.513543 24661 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "be76b618f4f142849d785428cd83c0f5" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62"
I20261120 09:03:24.513743 24661 raft_consensus.cc:3296] T be76b618f4f142849d785428cd83c0f5 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.514070 24661 raft_consensus.cc:2062] T be76b618f4f142849d785428cd83c0f5 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 8668dad23e404dafb0ac25267f07bd46 in term 1
I20261120 09:03:24.514402 24510 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "be76b618f4f142849d785428cd83c0f5" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3"
I20261120 09:03:24.514679 24510 raft_consensus.cc:3296] T be76b618f4f142849d785428cd83c0f5 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.515008 24510 raft_consensus.cc:2062] T be76b618f4f142849d785428cd83c0f5 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 8668dad23e404dafb0ac25267f07bd46 in term 1
I20261120 09:03:24.515237 24990 raft_consensus.cc:3024] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Leader election won for term 1
I20261120 09:03:24.515379 24990 raft_consensus.cc:744] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 LEADER]: Becoming Leader. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Running, Role: LEADER
I20261120 09:03:24.520155 24742 leader_election.cc:304] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46; no voters: 
I20261120 09:03:24.520565 24936 raft_consensus.cc:3024] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Leader election won for term 1
I20261120 09:03:24.520712 24936 raft_consensus.cc:744] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46 [term 1 LEADER]: Becoming Leader. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Running, Role: LEADER
I20261120 09:03:24.521217 24936 consensus_queue.cc:238] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.522742 24990 consensus_queue.cc:238] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2fb9ff0dc3d849d7bcf95806233d2c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:24.534107 24918 tablet_bootstrap.cc:492] T 8732692e59194cdabba0578275da133b P 8668dad23e404dafb0ac25267f07bd46: No bootstrap required, opened a new log
I20261120 09:03:24.534284 24918 ts_tablet_manager.cc:1449] T 8732692e59194cdabba0578275da133b P 8668dad23e404dafb0ac25267f07bd46: Time spent bootstrapping tablet: real 0.069s	user 0.004s	sys 0.000s
I20261120 09:03:24.535051 24918 raft_consensus.cc:366] T 8732692e59194cdabba0578275da133b P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.535238 24918 raft_consensus.cc:392] T 8732692e59194cdabba0578275da133b P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:24.535327 24918 raft_consensus.cc:787] T 8732692e59194cdabba0578275da133b P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Initialized, Role: FOLLOWER
I20261120 09:03:24.535563 24918 consensus_queue.cc:261] T 8732692e59194cdabba0578275da133b P 8668dad23e404dafb0ac25267f07bd46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.536036 24918 ts_tablet_manager.cc:1480] T 8732692e59194cdabba0578275da133b P 8668dad23e404dafb0ac25267f07bd46: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
I20261120 09:03:24.536317 24918 tablet_bootstrap.cc:492] T a27e6c05e40742d4ab0116c2e22cd4ba P 8668dad23e404dafb0ac25267f07bd46: Bootstrap starting.
I20261120 09:03:24.537920 24918 tablet_bootstrap.cc:654] T a27e6c05e40742d4ab0116c2e22cd4ba P 8668dad23e404dafb0ac25267f07bd46: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:24.546664 24918 tablet_bootstrap.cc:492] T a27e6c05e40742d4ab0116c2e22cd4ba P 8668dad23e404dafb0ac25267f07bd46: No bootstrap required, opened a new log
I20261120 09:03:24.546831 24918 ts_tablet_manager.cc:1449] T a27e6c05e40742d4ab0116c2e22cd4ba P 8668dad23e404dafb0ac25267f07bd46: Time spent bootstrapping tablet: real 0.011s	user 0.005s	sys 0.000s
I20261120 09:03:24.547824 24918 raft_consensus.cc:366] T a27e6c05e40742d4ab0116c2e22cd4ba P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.548049 24918 raft_consensus.cc:392] T a27e6c05e40742d4ab0116c2e22cd4ba P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:24.548133 24918 raft_consensus.cc:787] T a27e6c05e40742d4ab0116c2e22cd4ba P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Initialized, Role: FOLLOWER
I20261120 09:03:24.548393 24918 consensus_queue.cc:261] T a27e6c05e40742d4ab0116c2e22cd4ba P 8668dad23e404dafb0ac25267f07bd46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.551177 24918 ts_tablet_manager.cc:1480] T a27e6c05e40742d4ab0116c2e22cd4ba P 8668dad23e404dafb0ac25267f07bd46: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
I20261120 09:03:24.574119 24999 consensus_queue.cc:1049] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:24.588482 24933 consensus_queue.cc:1049] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2fb9ff0dc3d849d7bcf95806233d2c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:24.600930 24933 consensus_queue.cc:1049] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2fb9ff0dc3d849d7bcf95806233d2c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:24.611685 24936 consensus_queue.cc:1049] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:24.650947 24919 tablet_bootstrap.cc:492] T 707757cc32af4fe98d4a04e6a7498c17 P 2fb9ff0dc3d849d7bcf95806233d2c62: No bootstrap required, opened a new log
I20261120 09:03:24.651113 24919 ts_tablet_manager.cc:1449] T 707757cc32af4fe98d4a04e6a7498c17 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent bootstrapping tablet: real 0.168s	user 0.018s	sys 0.056s
I20261120 09:03:24.651822 24919 raft_consensus.cc:366] T 707757cc32af4fe98d4a04e6a7498c17 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } }
I20261120 09:03:24.652029 24919 raft_consensus.cc:392] T 707757cc32af4fe98d4a04e6a7498c17 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20261120 09:03:24.651530 24742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.79.65:40677, user_credentials={real_user=slave}} blocked reactor thread for 77813.2us
I20261120 09:03:24.652144 24919 raft_consensus.cc:787] T 707757cc32af4fe98d4a04e6a7498c17 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Initialized, Role: FOLLOWER
I20261120 09:03:24.652446 24919 consensus_queue.cc:261] T 707757cc32af4fe98d4a04e6a7498c17 P 2fb9ff0dc3d849d7bcf95806233d2c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } }
I20261120 09:03:24.653003 24919 ts_tablet_manager.cc:1480] T 707757cc32af4fe98d4a04e6a7498c17 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
I20261120 09:03:24.666949 24990 raft_consensus.cc:534] T a48b8166531548208bf3ae77f7380555 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:24.667119 24990 raft_consensus.cc:556] T a48b8166531548208bf3ae77f7380555 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.667716 24990 leader_election.cc:290] T a48b8166531548208bf3ae77f7380555 P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677), 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:24.668401 24508 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "a48b8166531548208bf3ae77f7380555" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3" is_pre_election: true
I20261120 09:03:24.668695 24508 raft_consensus.cc:2062] T a48b8166531548208bf3ae77f7380555 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 2fb9ff0dc3d849d7bcf95806233d2c62 in term 0
I20261120 09:03:24.668731 24808 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "a48b8166531548208bf3ae77f7380555" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46" is_pre_election: true
I20261120 09:03:24.668968 24808 raft_consensus.cc:2062] T a48b8166531548208bf3ae77f7380555 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 2fb9ff0dc3d849d7bcf95806233d2c62 in term 0
I20261120 09:03:24.669129 24595 leader_election.cc:304] T a48b8166531548208bf3ae77f7380555 P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 
I20261120 09:03:24.669625 24990 raft_consensus.cc:3024] T a48b8166531548208bf3ae77f7380555 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261120 09:03:24.669737 24990 raft_consensus.cc:534] T a48b8166531548208bf3ae77f7380555 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261120 09:03:24.669845 24990 raft_consensus.cc:3296] T a48b8166531548208bf3ae77f7380555 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.670115 24990 raft_consensus.cc:556] T a48b8166531548208bf3ae77f7380555 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
W20261120 09:03:24.673940 24924 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261120 09:03:24.674320 24924 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261120 09:03:24.674439 24924 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20261120 09:03:24.675498 24990 leader_election.cc:290] T a48b8166531548208bf3ae77f7380555 P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 election: Requested vote from peers 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677), 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:24.676210 24808 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "a48b8166531548208bf3ae77f7380555" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46"
I20261120 09:03:24.676415 24808 raft_consensus.cc:3296] T a48b8166531548208bf3ae77f7380555 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.676826 24808 raft_consensus.cc:2062] T a48b8166531548208bf3ae77f7380555 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 2fb9ff0dc3d849d7bcf95806233d2c62 in term 1
I20261120 09:03:24.677258 24508 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "a48b8166531548208bf3ae77f7380555" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3"
I20261120 09:03:24.677476 24508 raft_consensus.cc:3296] T a48b8166531548208bf3ae77f7380555 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.677911 24508 raft_consensus.cc:2062] T a48b8166531548208bf3ae77f7380555 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 2fb9ff0dc3d849d7bcf95806233d2c62 in term 1
I20261120 09:03:24.681424 24595 leader_election.cc:304] T a48b8166531548208bf3ae77f7380555 P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 
I20261120 09:03:24.681664 24990 raft_consensus.cc:3024] T a48b8166531548208bf3ae77f7380555 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Leader election won for term 1
I20261120 09:03:24.681833 24990 raft_consensus.cc:744] T a48b8166531548208bf3ae77f7380555 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 LEADER]: Becoming Leader. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Running, Role: LEADER
I20261120 09:03:24.682101 24990 consensus_queue.cc:238] T a48b8166531548208bf3ae77f7380555 P 2fb9ff0dc3d849d7bcf95806233d2c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
W20261120 09:03:24.687487 24924 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20261120 09:03:24.687582 24924 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261120 09:03:24.687667 24924 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20261120 09:03:24.687721 24924 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20261120 09:03:24.693531 24321 catalog_manager.cc:3546] renamed table default.table_44e6e9d80f3244618eb164246f389566 [id=cb55967ea90e43be8da1354763f7984c] in HMS: new name default.table_39131cc9c462405ba3639c841ebfe256
W20261120 09:03:24.701649 24317 catalog_manager.cc:7244] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_67a0134c1cdf49a49bea9d4b2818b558 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20261120 09:03:24.702869 24314 catalog_manager.cc:7244] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_b329d3b2bb9a409b9290011073304555 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20261120 09:03:24.703373 24924 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.79.84:36147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:38755
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.79.126:41659
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.79.126
--webserver_port=33973
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 36b6772d828145f8fbba3c49746c86838683f9ba
build type FASTDEBUG
built by None at 20 Nov 2026 08:44:26 UTC on bdcb31816ec0
build id 14873
ASAN enabled
W20261120 09:03:24.704210 24313 catalog_manager.cc:7244] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_f0940064a6844fdaadb8859f4257b11f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20261120 09:03:24.705089 24315 catalog_manager.cc:7244] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_797fe36dbbf14c0c8e085d8470e75a24 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20261120 09:03:24.705472 24924 env_posix.cc:2337] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261120 09:03:24.708039 24924 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20261120 09:03:24.715799 25022 raft_consensus.cc:534] T 707757cc32af4fe98d4a04e6a7498c17 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:24.716382 25022 raft_consensus.cc:556] T 707757cc32af4fe98d4a04e6a7498c17 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } }
I20261120 09:03:24.720252 24986 raft_consensus.cc:534] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:24.720439 24986 raft_consensus.cc:556] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.721597 24986 leader_election.cc:290] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:24.726975 24661 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "a8cf83af75c745dc96cb98f99cd2335d" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" is_pre_election: true
I20261120 09:03:24.727500 24661 raft_consensus.cc:2062] T a8cf83af75c745dc96cb98f99cd2335d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 0
I20261120 09:03:24.728024 24445 leader_election.cc:304] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 
I20261120 09:03:24.728449 24986 raft_consensus.cc:3024] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261120 09:03:24.728595 24986 raft_consensus.cc:534] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261120 09:03:24.728788 24986 raft_consensus.cc:3296] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.732403 24986 raft_consensus.cc:556] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.733875 24662 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "a8cf83af75c745dc96cb98f99cd2335d" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62"
I20261120 09:03:24.734084 24662 raft_consensus.cc:3296] T a8cf83af75c745dc96cb98f99cd2335d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.734088 24986 leader_election.cc:290] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 election: Requested vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:24.734313 24986 raft_consensus.cc:534] T a27e6c05e40742d4ab0116c2e22cd4ba P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:24.734386 24662 raft_consensus.cc:2062] T a8cf83af75c745dc96cb98f99cd2335d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 1
I20261120 09:03:24.734534 24986 raft_consensus.cc:556] T a27e6c05e40742d4ab0116c2e22cd4ba P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.735481 24660 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "a27e6c05e40742d4ab0116c2e22cd4ba" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" is_pre_election: true
I20261120 09:03:24.735703 24660 raft_consensus.cc:2062] T a27e6c05e40742d4ab0116c2e22cd4ba P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 0
I20261120 09:03:24.736250 24445 leader_election.cc:304] T a27e6c05e40742d4ab0116c2e22cd4ba P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 
I20261120 09:03:24.736536 24934 raft_consensus.cc:3024] T a27e6c05e40742d4ab0116c2e22cd4ba P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261120 09:03:24.736624 24934 raft_consensus.cc:534] T a27e6c05e40742d4ab0116c2e22cd4ba P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261120 09:03:24.736701 24934 raft_consensus.cc:3296] T a27e6c05e40742d4ab0116c2e22cd4ba P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.740294 24934 raft_consensus.cc:556] T a27e6c05e40742d4ab0116c2e22cd4ba P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.741914 24934 leader_election.cc:290] T a27e6c05e40742d4ab0116c2e22cd4ba P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 election: Requested vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:24.742101 24934 raft_consensus.cc:534] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:24.742223 24934 raft_consensus.cc:556] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.743301 24662 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "a27e6c05e40742d4ab0116c2e22cd4ba" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62"
I20261120 09:03:24.743511 24662 raft_consensus.cc:3296] T a27e6c05e40742d4ab0116c2e22cd4ba P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.743861 24662 raft_consensus.cc:2062] T a27e6c05e40742d4ab0116c2e22cd4ba P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 1
I20261120 09:03:24.747893 24445 leader_election.cc:304] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 
I20261120 09:03:24.748193 24980 raft_consensus.cc:3024] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Leader election won for term 1
I20261120 09:03:24.748418 24980 raft_consensus.cc:744] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3 [term 1 LEADER]: Becoming Leader. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Running, Role: LEADER
I20261120 09:03:24.748767 24980 consensus_queue.cc:238] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.748930 24445 leader_election.cc:304] T a27e6c05e40742d4ab0116c2e22cd4ba P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 
I20261120 09:03:24.749439 24974 raft_consensus.cc:3024] T a27e6c05e40742d4ab0116c2e22cd4ba P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Leader election won for term 1
I20261120 09:03:24.749593 24974 raft_consensus.cc:744] T a27e6c05e40742d4ab0116c2e22cd4ba P 2c3fe57b9d2c424da181281af303f3c3 [term 1 LEADER]: Becoming Leader. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Running, Role: LEADER
I20261120 09:03:24.749939 24974 consensus_queue.cc:238] T a27e6c05e40742d4ab0116c2e22cd4ba P 2c3fe57b9d2c424da181281af303f3c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
W20261120 09:03:24.752339 25031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261120 09:03:24.752697 24660 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "8732692e59194cdabba0578275da133b" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" is_pre_election: true
I20261120 09:03:24.752941 24660 raft_consensus.cc:2062] T 8732692e59194cdabba0578275da133b P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 0
I20261120 09:03:24.751952 24934 leader_election.cc:290] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:24.753912 24445 leader_election.cc:304] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 
I20261120 09:03:24.754297 24969 consensus_queue.cc:1049] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:24.754802 24969 raft_consensus.cc:3024] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261120 09:03:24.754935 24969 raft_consensus.cc:534] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261120 09:03:24.755061 24969 raft_consensus.cc:3296] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.755379 24969 raft_consensus.cc:556] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.765426 24986 leader_election.cc:290] T a27e6c05e40742d4ab0116c2e22cd4ba P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:24.770099 24969 leader_election.cc:290] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 election: Requested vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:24.771517 24660 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "8732692e59194cdabba0578275da133b" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62"
I20261120 09:03:24.771763 24660 raft_consensus.cc:3296] T 8732692e59194cdabba0578275da133b P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.772162 24660 raft_consensus.cc:2062] T 8732692e59194cdabba0578275da133b P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 1
I20261120 09:03:24.776453 24445 leader_election.cc:304] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 
I20261120 09:03:24.776837 24969 raft_consensus.cc:3024] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Leader election won for term 1
I20261120 09:03:24.776974 24969 raft_consensus.cc:744] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3 [term 1 LEADER]: Becoming Leader. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Running, Role: LEADER
I20261120 09:03:24.777213 24969 consensus_queue.cc:238] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.775002 24807 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "a8cf83af75c745dc96cb98f99cd2335d" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46" is_pre_election: true
I20261120 09:03:24.775570 24806 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "a8cf83af75c745dc96cb98f99cd2335d" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46"
I20261120 09:03:24.776063 24805 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "a27e6c05e40742d4ab0116c2e22cd4ba" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46"
I20261120 09:03:24.783131 24805 raft_consensus.cc:3296] T a27e6c05e40742d4ab0116c2e22cd4ba P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.783634 24805 raft_consensus.cc:2062] T a27e6c05e40742d4ab0116c2e22cd4ba P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 1
I20261120 09:03:24.776306 24804 raft_consensus.cc:3296] T a8cf83af75c745dc96cb98f99cd2335d P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.787564 24660 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "707757cc32af4fe98d4a04e6a7498c17" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" is_pre_election: true
I20261120 09:03:24.787801 24660 raft_consensus.cc:2062] T 707757cc32af4fe98d4a04e6a7498c17 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 8668dad23e404dafb0ac25267f07bd46 in term 0
I20261120 09:03:24.788187 24744 leader_election.cc:304] T 707757cc32af4fe98d4a04e6a7498c17 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62, 8668dad23e404dafb0ac25267f07bd46; no voters: 
I20261120 09:03:24.789510 24999 raft_consensus.cc:3024] T 707757cc32af4fe98d4a04e6a7498c17 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261120 09:03:24.789681 24999 raft_consensus.cc:534] T 707757cc32af4fe98d4a04e6a7498c17 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261120 09:03:24.789839 24999 raft_consensus.cc:3296] T 707757cc32af4fe98d4a04e6a7498c17 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.790194 24999 raft_consensus.cc:556] T 707757cc32af4fe98d4a04e6a7498c17 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } }
W20261120 09:03:24.794433 25041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261120 09:03:24.794566 24660 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "707757cc32af4fe98d4a04e6a7498c17" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62"
I20261120 09:03:24.794870 24660 raft_consensus.cc:3296] T 707757cc32af4fe98d4a04e6a7498c17 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.795249 24660 raft_consensus.cc:2062] T 707757cc32af4fe98d4a04e6a7498c17 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 8668dad23e404dafb0ac25267f07bd46 in term 1
I20261120 09:03:24.795455 24999 leader_election.cc:290] T 707757cc32af4fe98d4a04e6a7498c17 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 election: Requested vote from peers 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677), 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879)
I20261120 09:03:24.798190 24744 leader_election.cc:304] T 707757cc32af4fe98d4a04e6a7498c17 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62, 8668dad23e404dafb0ac25267f07bd46; no voters: 
W20261120 09:03:24.794747 25032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261120 09:03:24.794890 24924 server_base.cc:1061] running on GCE node
I20261120 09:03:24.798659 25022 leader_election.cc:290] T 707757cc32af4fe98d4a04e6a7498c17 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677), 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879)
I20261120 09:03:24.798914 25022 raft_consensus.cc:3024] T 707757cc32af4fe98d4a04e6a7498c17 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Leader election won for term 1
I20261120 09:03:24.799098 25022 raft_consensus.cc:744] T 707757cc32af4fe98d4a04e6a7498c17 P 8668dad23e404dafb0ac25267f07bd46 [term 1 LEADER]: Becoming Leader. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Running, Role: LEADER
I20261120 09:03:24.799365 25022 consensus_queue.cc:238] T 707757cc32af4fe98d4a04e6a7498c17 P 8668dad23e404dafb0ac25267f07bd46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } }
I20261120 09:03:24.799649 24924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261120 09:03:24.801339 24804 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "8732692e59194cdabba0578275da133b" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46" is_pre_election: true
I20261120 09:03:24.801502 24805 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "a27e6c05e40742d4ab0116c2e22cd4ba" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46" is_pre_election: true
I20261120 09:03:24.801569 24804 raft_consensus.cc:2062] T 8732692e59194cdabba0578275da133b P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 0
I20261120 09:03:24.801695 24805 raft_consensus.cc:2612] T a27e6c05e40742d4ab0116c2e22cd4ba P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Leader pre-election vote request: already granted 'yes' vote to 2c3fe57b9d2c424da181281af303f3c3 in term 1; re-sending same reply
I20261120 09:03:24.802181 24805 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "8732692e59194cdabba0578275da133b" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46"
I20261120 09:03:24.802382 24805 raft_consensus.cc:3296] T 8732692e59194cdabba0578275da133b P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.802765 24805 raft_consensus.cc:2062] T 8732692e59194cdabba0578275da133b P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 1
I20261120 09:03:24.803562 24924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261120 09:03:24.804414 24508 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "707757cc32af4fe98d4a04e6a7498c17" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3" is_pre_election: true
I20261120 09:03:24.804726 24508 raft_consensus.cc:2062] T 707757cc32af4fe98d4a04e6a7498c17 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 8668dad23e404dafb0ac25267f07bd46 in term 0
I20261120 09:03:24.806900 24924 hybrid_clock.cc:648] HybridClock initialized: now 1795165404806731 us; error 148 us; skew 500 ppm
I20261120 09:03:24.807307 24924 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261120 09:03:24.812657 24508 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "707757cc32af4fe98d4a04e6a7498c17" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3"
I20261120 09:03:24.812894 24508 raft_consensus.cc:3296] T 707757cc32af4fe98d4a04e6a7498c17 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:24.813234 24508 raft_consensus.cc:2062] T 707757cc32af4fe98d4a04e6a7498c17 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 8668dad23e404dafb0ac25267f07bd46 in term 1
I20261120 09:03:24.817656 25039 raft_consensus.cc:534] T a8cf83af75c745dc96cb98f99cd2335d P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:24.817806 25039 raft_consensus.cc:556] T a8cf83af75c745dc96cb98f99cd2335d P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:24.818941 24934 consensus_queue.cc:1049] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:24.819092 24660 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "a8cf83af75c745dc96cb98f99cd2335d" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" is_pre_election: true
I20261120 09:03:24.819840 25039 leader_election.cc:290] T a8cf83af75c745dc96cb98f99cd2335d P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677), 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879)
I20261120 09:03:24.823318 24508 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "a8cf83af75c745dc96cb98f99cd2335d" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3" is_pre_election: true
I20261120 09:03:24.830720 24924 webserver.cc:577] Webserver started at http://127.23.79.126:33973/ using document root <none> and password file <none>
I20261120 09:03:24.831812 24924 fs_manager.cc:362] Metadata directory not provided
I20261120 09:03:24.831959 24924 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261120 09:03:24.843269 24980 consensus_queue.cc:1049] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:24.850838 24924 fs_manager.cc:714] Time spent opening directory manager: real 0.016s	user 0.003s	sys 0.005s
I20261120 09:03:24.855031 24980 consensus_queue.cc:1049] T a27e6c05e40742d4ab0116c2e22cd4ba P 2c3fe57b9d2c424da181281af303f3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:24.869967 24936 consensus_queue.cc:1049] T 707757cc32af4fe98d4a04e6a7498c17 P 8668dad23e404dafb0ac25267f07bd46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:24.873580 25050 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
W20261120 09:03:24.878407 24742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.79.65:40677, user_credentials={real_user=slave}} blocked reactor thread for 52533.7us
I20261120 09:03:24.879518 24742 leader_election.cc:304] T a8cf83af75c745dc96cb98f99cd2335d P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8668dad23e404dafb0ac25267f07bd46; no voters: 2c3fe57b9d2c424da181281af303f3c3, 2fb9ff0dc3d849d7bcf95806233d2c62
I20261120 09:03:24.879968 24924 fs_manager.cc:730] Time spent opening block manager: real 0.027s	user 0.009s	sys 0.001s
I20261120 09:03:24.880164 24924 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data,/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/wal
uuid: "a99947e985094a3e8999fe2aa4e23f18"
format_stamp: "Formatted at 2026-11-20 09:03:19 on dist-test-slave-vzd6"
I20261120 09:03:24.881191 24924 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261120 09:03:24.881681 25022 raft_consensus.cc:2966] T a8cf83af75c745dc96cb98f99cd2335d P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261120 09:03:24.884224 24978 consensus_queue.cc:1049] T a48b8166531548208bf3ae77f7380555 P 2fb9ff0dc3d849d7bcf95806233d2c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:24.885324 24978 consensus_queue.cc:1049] T a48b8166531548208bf3ae77f7380555 P 2fb9ff0dc3d849d7bcf95806233d2c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:24.905689 24318 catalog_manager.cc:3546] renamed table default.table_3fae2942cff544c29c926cc5ed10a06c [id=315bdedf9fe44e5d866534884f65f6d4] in HMS: new name default.table_f9f890b63b384c3b9f30da0ba8a80c03
I20261120 09:03:24.927743 24934 consensus_queue.cc:1049] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:24.929105 24934 consensus_queue.cc:1049] T a27e6c05e40742d4ab0116c2e22cd4ba P 2c3fe57b9d2c424da181281af303f3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:24.930562 25022 consensus_queue.cc:1049] T 707757cc32af4fe98d4a04e6a7498c17 P 8668dad23e404dafb0ac25267f07bd46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20261120 09:03:24.945822 24377 catalog_manager.cc:6124] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8732692e59194cdabba0578275da133b consensus state has no leader
I20261120 09:03:24.949391 24321 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:41728 (request call id 11) took 1760 ms. Trace:
I20261120 09:03:24.949528 24321 rpcz_store.cc:276] 1120 09:03:23.188957 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:23.189003 (+    46us) service_pool.cc:224] Handling call
1120 09:03:24.028108 (+839105us) catalog_manager.cc:2437] Looking up, locking, and authorizing table
1120 09:03:24.948670 (+920562us) catalog_manager.cc:2437] Looking up, locking, and authorizing table
1120 09:03:24.949005 (+   335us) catalog_manager.cc:3769] Apply alter schema
1120 09:03:24.949354 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":2758,"Hive Metastore.run_cpu_time_us":1156,"Hive Metastore.run_wall_time_us":662183}
I20261120 09:03:24.955045 24489 tablet_service.cc:1542] Processing DeleteTablet for tablet fa8252fc6fee4aa7b20b53a08623e358 with delete_type TABLET_DATA_DELETED (replaced by tablet 707757cc32af4fe98d4a04e6a7498c17) from {username='slave'} at 127.0.0.1:50044
I20261120 09:03:24.959002 24641 tablet_service.cc:1542] Processing DeleteTablet for tablet aa0f46d52f9b4608ba87baf575d59f89 with delete_type TABLET_DATA_DELETED (replaced by tablet a27e6c05e40742d4ab0116c2e22cd4ba) from {username='slave'} at 127.0.0.1:40170
I20261120 09:03:24.970160 24321 catalog_manager.cc:5856] T be76b618f4f142849d785428cd83c0f5 P 2fb9ff0dc3d849d7bcf95806233d2c62 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67). New cstate: current_term: 1 leader_uuid: "8668dad23e404dafb0ac25267f07bd46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } }
I20261120 09:03:24.971912 24321 catalog_manager.cc:5856] T 75e156478a8a470ba5f4942cd8e6a89e P 2fb9ff0dc3d849d7bcf95806233d2c62 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65). New cstate: current_term: 1 leader_uuid: "2c3fe57b9d2c424da181281af303f3c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } }
W20261120 09:03:24.972489 24305 catalog_manager.cc:5048] TS 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): delete failed for tablet fa8252fc6fee4aa7b20b53a08623e358 because the tablet was not found. No further retry: Not found: Tablet not found: fa8252fc6fee4aa7b20b53a08623e358
W20261120 09:03:24.980163 24307 catalog_manager.cc:5048] TS 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): delete failed for tablet aa0f46d52f9b4608ba87baf575d59f89 because the tablet was not found. No further retry: Not found: Tablet not found: aa0f46d52f9b4608ba87baf575d59f89
I20261120 09:03:24.991544 24321 catalog_manager.cc:5856] T a8cf83af75c745dc96cb98f99cd2335d P 2fb9ff0dc3d849d7bcf95806233d2c62 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65). New cstate: current_term: 1 leader_uuid: "2c3fe57b9d2c424da181281af303f3c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } }
I20261120 09:03:25.000041 24321 catalog_manager.cc:5856] T e7f41973f62a48cf8b20ec4d965bfa6e P 2fb9ff0dc3d849d7bcf95806233d2c62 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65). New cstate: current_term: 1 leader_uuid: "2c3fe57b9d2c424da181281af303f3c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } }
I20261120 09:03:25.000597 24321 catalog_manager.cc:5856] T 8732692e59194cdabba0578275da133b P 2fb9ff0dc3d849d7bcf95806233d2c62 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65). New cstate: current_term: 1 leader_uuid: "2c3fe57b9d2c424da181281af303f3c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } }
I20261120 09:03:25.001114 24321 catalog_manager.cc:5956] TS 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879) does not have the latest schema for tablet 8732692e59194cdabba0578275da133b (table default.table_39131cc9c462405ba3639c841ebfe256 [id=cb55967ea90e43be8da1354763f7984c]). Expected version 1 got 0
I20261120 09:03:25.001778 24321 catalog_manager.cc:5856] T 707757cc32af4fe98d4a04e6a7498c17 P 2fb9ff0dc3d849d7bcf95806233d2c62 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67). New cstate: current_term: 1 leader_uuid: "8668dad23e404dafb0ac25267f07bd46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } }
I20261120 09:03:25.003515 24321 catalog_manager.cc:5856] T a27e6c05e40742d4ab0116c2e22cd4ba P 2fb9ff0dc3d849d7bcf95806233d2c62 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65). New cstate: current_term: 1 leader_uuid: "2c3fe57b9d2c424da181281af303f3c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } }
W20261120 09:03:25.005211 24308 catalog_manager.cc:4863] Async tablet task AlterTable RPC for tablet 8732692e59194cdabba0578275da133b (table default.table_39131cc9c462405ba3639c841ebfe256 [id=cb55967ea90e43be8da1354763f7984c], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8732692e59194cdabba0578275da133b consensus state has no leader
I20261120 09:03:25.017630 24321 catalog_manager.cc:5856] T 8155295b7e8e40ddaedeb2e9c24f1245 P 2fb9ff0dc3d849d7bcf95806233d2c62 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66). New cstate: current_term: 1 leader_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } health_report { overall_health: HEALTHY } } }
I20261120 09:03:25.018380 24321 catalog_manager.cc:5856] T a48b8166531548208bf3ae77f7380555 P 2fb9ff0dc3d849d7bcf95806233d2c62 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66). New cstate: current_term: 1 leader_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } health_report { overall_health: HEALTHY } } }
I20261120 09:03:25.018927 24321 catalog_manager.cc:5856] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66). New cstate: current_term: 1 leader_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } health_report { overall_health: HEALTHY } } }
I20261120 09:03:25.050202 24924 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261120 09:03:25.051090 24321 catalog_manager.cc:5956] TS 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677) does not have the latest schema for tablet 8732692e59194cdabba0578275da133b (table default.table_39131cc9c462405ba3639c841ebfe256 [id=cb55967ea90e43be8da1354763f7984c]). Expected version 1 got 0
I20261120 09:03:25.051412 24924 env_posix.cc:2337] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261120 09:03:25.051692 24924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261120 09:03:25.061055 24321 catalog_manager.cc:5956] TS 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035) does not have the latest schema for tablet 8732692e59194cdabba0578275da133b (table default.table_39131cc9c462405ba3639c841ebfe256 [id=cb55967ea90e43be8da1354763f7984c]). Expected version 1 got 0
I20261120 09:03:25.073355 24321 catalog_manager.cc:5956] TS 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035) does not have the latest schema for tablet 8732692e59194cdabba0578275da133b (table default.table_39131cc9c462405ba3639c841ebfe256 [id=cb55967ea90e43be8da1354763f7984c]). Expected version 1 got 0
I20261120 09:03:25.078630 24321 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41728:
name: "default.Table_ebc744ebb12d4dd498ca3721c3b9ac6a"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:25.100077 25073 tablet.cc:1872] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20261120 09:03:25.102983 25074 tablet.cc:1872] T 8732692e59194cdabba0578275da133b P 8668dad23e404dafb0ac25267f07bd46: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20261120 09:03:25.106204 25075 tablet.cc:1872] T 8732692e59194cdabba0578275da133b P 2fb9ff0dc3d849d7bcf95806233d2c62: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20261120 09:03:25.128456 24319 catalog_manager.cc:3546] renamed table default.table_d5638af53ccf40f2b367cf74de29e633 [id=83bafe99e25046a4a43a3739a3ca07a1] in HMS: new name default.table_0d4b09a9b1754e38bca62e97c14a0854
I20261120 09:03:25.208019 24320 catalog_manager.cc:3546] renamed table default.table_eb77729285254174a498bb17a0adceea [id=90570e46cebe47eba97e5b980f23e909] in HMS: new name default.table_4d5337371cd3454fa5aae228272e5fda
I20261120 09:03:25.215555 24924 rpc_server.cc:307] RPC server started. Bound to: 127.23.79.126:41659
I20261120 09:03:25.217221 25116 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.79.126:41659 every 8 connection(s)
I20261120 09:03:25.217741 24924 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data/info.pb
I20261120 09:03:25.227702 23869 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu as pid 24924
I20261120 09:03:25.251220 25117 sys_catalog.cc:263] Verifying existing consensus state
I20261120 09:03:25.256618 24317 catalog_manager.cc:2218] created HMS catalog entry for table  [id=7510ae7af246485ca9d5b539b3f90bbb]
I20261120 09:03:25.263021 25117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: Bootstrap starting.
I20261120 09:03:25.266247 24317 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:41728 (request call id 20) took 1877 ms. Trace:
I20261120 09:03:25.266358 24317 rpcz_store.cc:276] 1120 09:03:23.389063 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:23.507463 (+118400us) service_pool.cc:224] Handling call
1120 09:03:24.701813 (+1194350us) catalog_manager.cc:2145] Acquired catalog manager lock
1120 09:03:24.702362 (+   549us) catalog_manager.cc:2191] Created new table and tablet info
1120 09:03:25.256582 (+554220us) catalog_manager.cc:2217] Created new table in HMS catalog
1120 09:03:25.265955 (+  9373us) catalog_manager.cc:2251] Wrote table and tablets to system table
1120 09:03:25.266081 (+   126us) catalog_manager.cc:2285] Inserted table and tablets into CatalogManager maps
1120 09:03:25.266188 (+   107us) inbound_call.cc:177] Queueing success response
Related trace 'op':
1120 09:03:25.257437 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1120 09:03:25.257562 (+   125us) write_op.cc:437] Acquiring schema lock in shared mode
1120 09:03:25.257571 (+     9us) write_op.cc:440] Acquired schema lock
1120 09:03:25.257591 (+    20us) tablet.cc:710] Decoding operations
1120 09:03:25.257700 (+   109us) write_op.cc:625] Acquiring the partition lock for write op
1120 09:03:25.257715 (+    15us) write_op.cc:646] Partition lock acquired for write op
1120 09:03:25.257721 (+     6us) tablet.cc:742] Acquiring locks for 2 operations
1120 09:03:25.257830 (+   109us) tablet.cc:758] Row locks acquired
1120 09:03:25.257833 (+     3us) write_op.cc:260] PREPARE: finished
1120 09:03:25.257877 (+    44us) write_op.cc:270] Start()
1120 09:03:25.257916 (+    39us) write_op.cc:276] Timestamp: P: 1795165405257848 usec, L: 0
1120 09:03:25.257920 (+     4us) op_driver.cc:350] REPLICATION: starting
1120 09:03:25.258138 (+   218us) log.cc:844] Serialized 432 byte log entry
1120 09:03:25.262071 (+  3933us) op_driver.cc:466] REPLICATION: finished
1120 09:03:25.262210 (+   139us) write_op.cc:301] APPLY: starting
1120 09:03:25.262227 (+    17us) tablet.cc:1451] starting BulkCheckPresence
1120 09:03:25.262269 (+    42us) tablet.cc:1454] finished BulkCheckPresence
1120 09:03:25.262297 (+    28us) tablet.cc:1456] starting ApplyRowOperation cycle
1120 09:03:25.262425 (+   128us) tablet.cc:1467] finished ApplyRowOperation cycle
1120 09:03:25.262461 (+    36us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
1120 09:03:25.262470 (+     9us) write_op.cc:312] APPLY: finished
1120 09:03:25.262590 (+   120us) log.cc:844] Serialized 28 byte log entry
1120 09:03:25.262647 (+    57us) write_op.cc:494] Releasing partition, row and schema locks
1120 09:03:25.262667 (+    20us) write_op.cc:459] Released schema lock
1120 09:03:25.262673 (+     6us) write_op.cc:346] FINISH: Updating metrics
1120 09:03:25.262741 (+    68us) write_op.cc:494] Releasing partition, row and schema locks
1120 09:03:25.262746 (+     5us) write_op.cc:459] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":505260,"Hive Metastore.run_cpu_time_us":309,"Hive Metastore.run_wall_time_us":48508,"child_traces":[["op",{"apply.queue_time_us":93,"apply.run_cpu_time_us":520,"apply.run_wall_time_us":519,"num_ops":2,"prepare.queue_time_us":100,"prepare.run_cpu_time_us":829,"prepare.run_wall_time_us":830,"raft.queue_time_us":1565,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":324,"replication_time_us":4125}]]}
I20261120 09:03:25.268055 24317 catalog_manager.cc:5956] TS 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677) does not have the latest schema for tablet 8732692e59194cdabba0578275da133b (table default.table_39131cc9c462405ba3639c841ebfe256 [id=cb55967ea90e43be8da1354763f7984c]). Expected version 1 got 0
I20261120 09:03:25.287693 25117 log.cc:826] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: Log is configured to *not* fsync() on all Append() calls
I20261120 09:03:25.290978 24489 tablet_service.cc:1495] Processing CreateTablet for tablet 6130d88766ca4ced867fb83be00a00f5 (DEFAULT_TABLE table=default.table_67a0134c1cdf49a49bea9d4b2818b558 [id=7510ae7af246485ca9d5b539b3f90bbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:25.291428 24489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6130d88766ca4ced867fb83be00a00f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:25.292779 24788 tablet_service.cc:1495] Processing CreateTablet for tablet 6130d88766ca4ced867fb83be00a00f5 (DEFAULT_TABLE table=default.table_67a0134c1cdf49a49bea9d4b2818b558 [id=7510ae7af246485ca9d5b539b3f90bbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:25.293265 24788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6130d88766ca4ced867fb83be00a00f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:25.293200 24641 tablet_service.cc:1495] Processing CreateTablet for tablet 6130d88766ca4ced867fb83be00a00f5 (DEFAULT_TABLE table=default.table_67a0134c1cdf49a49bea9d4b2818b558 [id=7510ae7af246485ca9d5b539b3f90bbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:25.293601 24641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6130d88766ca4ced867fb83be00a00f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:25.315584 25125 tablet_bootstrap.cc:492] T 6130d88766ca4ced867fb83be00a00f5 P 2c3fe57b9d2c424da181281af303f3c3: Bootstrap starting.
I20261120 09:03:25.317755 24314 catalog_manager.cc:2218] created HMS catalog entry for table  [id=3f913310fd9a49b6b264540325c0139e]
I20261120 09:03:25.326323 25124 tablet_bootstrap.cc:492] T 6130d88766ca4ced867fb83be00a00f5 P 8668dad23e404dafb0ac25267f07bd46: Bootstrap starting.
I20261120 09:03:25.326820 25123 tablet_bootstrap.cc:492] T 6130d88766ca4ced867fb83be00a00f5 P 2fb9ff0dc3d849d7bcf95806233d2c62: Bootstrap starting.
I20261120 09:03:25.328264 25125 tablet_bootstrap.cc:654] T 6130d88766ca4ced867fb83be00a00f5 P 2c3fe57b9d2c424da181281af303f3c3: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:25.328346 24314 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:41728 (request call id 22) took 1849 ms. Trace:
I20261120 09:03:25.328460 24314 rpcz_store.cc:276] 1120 09:03:23.478559 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:23.824557 (+345998us) service_pool.cc:224] Handling call
1120 09:03:24.702984 (+878427us) catalog_manager.cc:2145] Acquired catalog manager lock
1120 09:03:24.703492 (+   508us) catalog_manager.cc:2191] Created new table and tablet info
1120 09:03:25.317709 (+614217us) catalog_manager.cc:2217] Created new table in HMS catalog
1120 09:03:25.328043 (+ 10334us) catalog_manager.cc:2251] Wrote table and tablets to system table
1120 09:03:25.328172 (+   129us) catalog_manager.cc:2285] Inserted table and tablets into CatalogManager maps
1120 09:03:25.328286 (+   114us) inbound_call.cc:177] Queueing success response
Related trace 'op':
1120 09:03:25.318641 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1120 09:03:25.318747 (+   106us) write_op.cc:437] Acquiring schema lock in shared mode
1120 09:03:25.318752 (+     5us) write_op.cc:440] Acquired schema lock
1120 09:03:25.318755 (+     3us) tablet.cc:710] Decoding operations
1120 09:03:25.318852 (+    97us) write_op.cc:625] Acquiring the partition lock for write op
1120 09:03:25.318864 (+    12us) write_op.cc:646] Partition lock acquired for write op
1120 09:03:25.318869 (+     5us) tablet.cc:742] Acquiring locks for 2 operations
1120 09:03:25.318938 (+    69us) tablet.cc:758] Row locks acquired
1120 09:03:25.318941 (+     3us) write_op.cc:260] PREPARE: finished
1120 09:03:25.318968 (+    27us) write_op.cc:270] Start()
1120 09:03:25.318992 (+    24us) write_op.cc:276] Timestamp: P: 1795165405318937 usec, L: 0
1120 09:03:25.318996 (+     4us) op_driver.cc:350] REPLICATION: starting
1120 09:03:25.319132 (+   136us) log.cc:844] Serialized 432 byte log entry
1120 09:03:25.326806 (+  7674us) op_driver.cc:466] REPLICATION: finished
1120 09:03:25.327508 (+   702us) write_op.cc:301] APPLY: starting
1120 09:03:25.327524 (+    16us) tablet.cc:1451] starting BulkCheckPresence
1120 09:03:25.327560 (+    36us) tablet.cc:1454] finished BulkCheckPresence
1120 09:03:25.327583 (+    23us) tablet.cc:1456] starting ApplyRowOperation cycle
1120 09:03:25.327686 (+   103us) tablet.cc:1467] finished ApplyRowOperation cycle
1120 09:03:25.327717 (+    31us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
1120 09:03:25.327724 (+     7us) write_op.cc:312] APPLY: finished
1120 09:03:25.327801 (+    77us) log.cc:844] Serialized 28 byte log entry
1120 09:03:25.327859 (+    58us) write_op.cc:494] Releasing partition, row and schema locks
1120 09:03:25.327876 (+    17us) write_op.cc:459] Released schema lock
1120 09:03:25.327881 (+     5us) write_op.cc:346] FINISH: Updating metrics
1120 09:03:25.327942 (+    61us) write_op.cc:494] Releasing partition, row and schema locks
1120 09:03:25.327946 (+     4us) write_op.cc:459] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":552693,"Hive Metastore.run_cpu_time_us":321,"Hive Metastore.run_wall_time_us":61132,"child_traces":[["op",{"apply.queue_time_us":641,"apply.run_cpu_time_us":433,"apply.run_wall_time_us":434,"num_ops":2,"prepare.queue_time_us":118,"prepare.run_cpu_time_us":552,"prepare.run_wall_time_us":552,"replication_time_us":7770}]]}
I20261120 09:03:25.330060 25123 tablet_bootstrap.cc:654] T 6130d88766ca4ced867fb83be00a00f5 P 2fb9ff0dc3d849d7bcf95806233d2c62: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:25.334933 25124 tablet_bootstrap.cc:654] T 6130d88766ca4ced867fb83be00a00f5 P 8668dad23e404dafb0ac25267f07bd46: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:25.336411 24317 catalog_manager.cc:6409] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: default.table_39131cc9c462405ba3639c841ebfe256 [id=cb55967ea90e43be8da1354763f7984c] alter complete (version 1)
I20261120 09:03:25.339551 24314 catalog_manager.cc:2551] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41728:
table { table_name: "default.Table_d68821f474e040e18b4d91fbbd850863" } modify_external_catalogs: true
I20261120 09:03:25.339884 24314 catalog_manager.cc:2799] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41728:
table { table_name: "default.Table_d68821f474e040e18b4d91fbbd850863" } modify_external_catalogs: true
I20261120 09:03:25.342083 25125 tablet_bootstrap.cc:492] T 6130d88766ca4ced867fb83be00a00f5 P 2c3fe57b9d2c424da181281af303f3c3: No bootstrap required, opened a new log
I20261120 09:03:25.342272 25125 ts_tablet_manager.cc:1449] T 6130d88766ca4ced867fb83be00a00f5 P 2c3fe57b9d2c424da181281af303f3c3: Time spent bootstrapping tablet: real 0.027s	user 0.000s	sys 0.006s
I20261120 09:03:25.343197 25125 raft_consensus.cc:366] T 6130d88766ca4ced867fb83be00a00f5 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:25.343426 25125 raft_consensus.cc:392] T 6130d88766ca4ced867fb83be00a00f5 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:25.343528 25125 raft_consensus.cc:787] T 6130d88766ca4ced867fb83be00a00f5 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Initialized, Role: FOLLOWER
I20261120 09:03:25.343763 25125 consensus_queue.cc:261] T 6130d88766ca4ced867fb83be00a00f5 P 2c3fe57b9d2c424da181281af303f3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:25.344316 25125 ts_tablet_manager.cc:1480] T 6130d88766ca4ced867fb83be00a00f5 P 2c3fe57b9d2c424da181281af303f3c3: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.000s
I20261120 09:03:25.366686 24568 heartbeater.cc:345] Connected to a master server at 127.23.79.126:41659
I20261120 09:03:25.376174 24490 tablet_service.cc:1495] Processing CreateTablet for tablet ab6cc162ae404f91a484d70756e3897f (DEFAULT_TABLE table=default.table_b329d3b2bb9a409b9290011073304555 [id=3f913310fd9a49b6b264540325c0139e]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:25.376684 24490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab6cc162ae404f91a484d70756e3897f. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:25.380664 24788 tablet_service.cc:1495] Processing CreateTablet for tablet ab6cc162ae404f91a484d70756e3897f (DEFAULT_TABLE table=default.table_b329d3b2bb9a409b9290011073304555 [id=3f913310fd9a49b6b264540325c0139e]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:25.381225 24788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab6cc162ae404f91a484d70756e3897f. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:25.393724 24641 tablet_service.cc:1495] Processing CreateTablet for tablet ab6cc162ae404f91a484d70756e3897f (DEFAULT_TABLE table=default.table_b329d3b2bb9a409b9290011073304555 [id=3f913310fd9a49b6b264540325c0139e]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:25.394203 24641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab6cc162ae404f91a484d70756e3897f. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:25.408005 25125 tablet_bootstrap.cc:492] T ab6cc162ae404f91a484d70756e3897f P 2c3fe57b9d2c424da181281af303f3c3: Bootstrap starting.
I20261120 09:03:25.410386 25125 tablet_bootstrap.cc:654] T ab6cc162ae404f91a484d70756e3897f P 2c3fe57b9d2c424da181281af303f3c3: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:25.411830 24317 catalog_manager.cc:2551] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41728:
table { table_name: "default.Table_b9d5ad28fd144956bd0715d85a6db556" } modify_external_catalogs: true
I20261120 09:03:25.413714 24317 catalog_manager.cc:2799] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41728:
table { table_name: "default.Table_b9d5ad28fd144956bd0715d85a6db556" } modify_external_catalogs: true
I20261120 09:03:25.421543 24287 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: OK, instance_id { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" instance_seqno: 1795165405152221 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20261120 09:03:25.421800 24287 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:03:25.423763 25123 tablet_bootstrap.cc:492] T 6130d88766ca4ced867fb83be00a00f5 P 2fb9ff0dc3d849d7bcf95806233d2c62: No bootstrap required, opened a new log
I20261120 09:03:25.423957 25123 ts_tablet_manager.cc:1449] T 6130d88766ca4ced867fb83be00a00f5 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent bootstrapping tablet: real 0.097s	user 0.005s	sys 0.023s
I20261120 09:03:25.424773 25123 raft_consensus.cc:366] T 6130d88766ca4ced867fb83be00a00f5 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:25.424968 25123 raft_consensus.cc:392] T 6130d88766ca4ced867fb83be00a00f5 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:25.425065 25123 raft_consensus.cc:787] T 6130d88766ca4ced867fb83be00a00f5 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Initialized, Role: FOLLOWER
I20261120 09:03:25.426159 25124 tablet_bootstrap.cc:492] T 6130d88766ca4ced867fb83be00a00f5 P 8668dad23e404dafb0ac25267f07bd46: No bootstrap required, opened a new log
I20261120 09:03:25.426355 25124 ts_tablet_manager.cc:1449] T 6130d88766ca4ced867fb83be00a00f5 P 8668dad23e404dafb0ac25267f07bd46: Time spent bootstrapping tablet: real 0.100s	user 0.008s	sys 0.020s
I20261120 09:03:25.427160 25124 raft_consensus.cc:366] T 6130d88766ca4ced867fb83be00a00f5 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:25.427382 25124 raft_consensus.cc:392] T 6130d88766ca4ced867fb83be00a00f5 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:25.427495 25124 raft_consensus.cc:787] T 6130d88766ca4ced867fb83be00a00f5 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Initialized, Role: FOLLOWER
I20261120 09:03:25.427734 25124 consensus_queue.cc:261] T 6130d88766ca4ced867fb83be00a00f5 P 8668dad23e404dafb0ac25267f07bd46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:25.431514 25123 consensus_queue.cc:261] T 6130d88766ca4ced867fb83be00a00f5 P 2fb9ff0dc3d849d7bcf95806233d2c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:25.442345 25123 ts_tablet_manager.cc:1480] T 6130d88766ca4ced867fb83be00a00f5 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent starting tablet: real 0.018s	user 0.000s	sys 0.002s
I20261120 09:03:25.442880 25124 ts_tablet_manager.cc:1480] T 6130d88766ca4ced867fb83be00a00f5 P 8668dad23e404dafb0ac25267f07bd46: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.000s
I20261120 09:03:25.443149 25124 tablet_bootstrap.cc:492] T ab6cc162ae404f91a484d70756e3897f P 8668dad23e404dafb0ac25267f07bd46: Bootstrap starting.
I20261120 09:03:25.449491 25123 tablet_bootstrap.cc:492] T ab6cc162ae404f91a484d70756e3897f P 2fb9ff0dc3d849d7bcf95806233d2c62: Bootstrap starting.
I20261120 09:03:25.451664 25123 tablet_bootstrap.cc:654] T ab6cc162ae404f91a484d70756e3897f P 2fb9ff0dc3d849d7bcf95806233d2c62: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:25.453768 24708 heartbeater.cc:345] Connected to a master server at 127.23.79.126:41659
I20261120 09:03:25.455837 24855 heartbeater.cc:345] Connected to a master server at 127.23.79.126:41659
I20261120 09:03:25.466126 25125 tablet_bootstrap.cc:492] T ab6cc162ae404f91a484d70756e3897f P 2c3fe57b9d2c424da181281af303f3c3: No bootstrap required, opened a new log
I20261120 09:03:25.466363 25125 ts_tablet_manager.cc:1449] T ab6cc162ae404f91a484d70756e3897f P 2c3fe57b9d2c424da181281af303f3c3: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.000s
I20261120 09:03:25.467389 25125 raft_consensus.cc:366] T ab6cc162ae404f91a484d70756e3897f P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:25.467635 25125 raft_consensus.cc:392] T ab6cc162ae404f91a484d70756e3897f P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:25.467731 25125 raft_consensus.cc:787] T ab6cc162ae404f91a484d70756e3897f P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Initialized, Role: FOLLOWER
I20261120 09:03:25.468039 25125 consensus_queue.cc:261] T ab6cc162ae404f91a484d70756e3897f P 2c3fe57b9d2c424da181281af303f3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:25.471421 25125 ts_tablet_manager.cc:1480] T ab6cc162ae404f91a484d70756e3897f P 2c3fe57b9d2c424da181281af303f3c3: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20261120 09:03:25.478086 25124 tablet_bootstrap.cc:654] T ab6cc162ae404f91a484d70756e3897f P 8668dad23e404dafb0ac25267f07bd46: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:25.489317 25117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261120 09:03:25.491987 25117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: Bootstrap complete.
I20261120 09:03:25.493980 25123 tablet_bootstrap.cc:492] T ab6cc162ae404f91a484d70756e3897f P 2fb9ff0dc3d849d7bcf95806233d2c62: No bootstrap required, opened a new log
I20261120 09:03:25.494177 25123 ts_tablet_manager.cc:1449] T ab6cc162ae404f91a484d70756e3897f P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent bootstrapping tablet: real 0.045s	user 0.000s	sys 0.006s
I20261120 09:03:25.495108 25123 raft_consensus.cc:366] T ab6cc162ae404f91a484d70756e3897f P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:25.495362 25123 raft_consensus.cc:392] T ab6cc162ae404f91a484d70756e3897f P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:25.495455 25123 raft_consensus.cc:787] T ab6cc162ae404f91a484d70756e3897f P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Initialized, Role: FOLLOWER
I20261120 09:03:25.496106 25123 consensus_queue.cc:261] T ab6cc162ae404f91a484d70756e3897f P 2fb9ff0dc3d849d7bcf95806233d2c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:25.497411 25124 tablet_bootstrap.cc:492] T ab6cc162ae404f91a484d70756e3897f P 8668dad23e404dafb0ac25267f07bd46: No bootstrap required, opened a new log
I20261120 09:03:25.497646 25124 ts_tablet_manager.cc:1449] T ab6cc162ae404f91a484d70756e3897f P 8668dad23e404dafb0ac25267f07bd46: Time spent bootstrapping tablet: real 0.055s	user 0.006s	sys 0.000s
I20261120 09:03:25.498533 25124 raft_consensus.cc:366] T ab6cc162ae404f91a484d70756e3897f P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:25.498838 25124 raft_consensus.cc:392] T ab6cc162ae404f91a484d70756e3897f P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:25.498930 25124 raft_consensus.cc:787] T ab6cc162ae404f91a484d70756e3897f P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Initialized, Role: FOLLOWER
I20261120 09:03:25.499233 25124 consensus_queue.cc:261] T ab6cc162ae404f91a484d70756e3897f P 8668dad23e404dafb0ac25267f07bd46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:25.501380 25124 ts_tablet_manager.cc:1480] T ab6cc162ae404f91a484d70756e3897f P 8668dad23e404dafb0ac25267f07bd46: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20261120 09:03:25.502707 24855 heartbeater.cc:345] Connected to a master server at 127.23.79.126:41659
I20261120 09:03:25.504745 24990 raft_consensus.cc:534] T ab6cc162ae404f91a484d70756e3897f P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:25.504904 24990 raft_consensus.cc:556] T ab6cc162ae404f91a484d70756e3897f P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:25.505635 24990 leader_election.cc:290] T ab6cc162ae404f91a484d70756e3897f P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677), 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:25.506453 24508 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "ab6cc162ae404f91a484d70756e3897f" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3" is_pre_election: true
I20261120 09:03:25.506843 24508 raft_consensus.cc:2062] T ab6cc162ae404f91a484d70756e3897f P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 2fb9ff0dc3d849d7bcf95806233d2c62 in term 0
I20261120 09:03:25.507488 24808 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "ab6cc162ae404f91a484d70756e3897f" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46" is_pre_election: true
I20261120 09:03:25.507783 24808 raft_consensus.cc:2062] T ab6cc162ae404f91a484d70756e3897f P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 2fb9ff0dc3d849d7bcf95806233d2c62 in term 0
I20261120 09:03:25.508596 24595 leader_election.cc:304] T ab6cc162ae404f91a484d70756e3897f P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 
I20261120 09:03:25.512977 24990 raft_consensus.cc:3024] T ab6cc162ae404f91a484d70756e3897f P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261120 09:03:25.513123 24990 raft_consensus.cc:534] T ab6cc162ae404f91a484d70756e3897f P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261120 09:03:25.513204 24990 raft_consensus.cc:3296] T ab6cc162ae404f91a484d70756e3897f P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:25.516888 25123 ts_tablet_manager.cc:1480] T ab6cc162ae404f91a484d70756e3897f P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.000s
I20261120 09:03:25.522890 24990 raft_consensus.cc:556] T ab6cc162ae404f91a484d70756e3897f P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:25.529485 24990 leader_election.cc:290] T ab6cc162ae404f91a484d70756e3897f P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 election: Requested vote from peers 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677), 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:25.527195 25117 raft_consensus.cc:366] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:25.530082 24508 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "ab6cc162ae404f91a484d70756e3897f" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3"
I20261120 09:03:25.530090 24808 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "ab6cc162ae404f91a484d70756e3897f" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46"
I20261120 09:03:25.530344 24508 raft_consensus.cc:3296] T ab6cc162ae404f91a484d70756e3897f P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:25.530349 24808 raft_consensus.cc:3296] T ab6cc162ae404f91a484d70756e3897f P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:25.530547 25117 raft_consensus.cc:787] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99947e985094a3e8999fe2aa4e23f18, State: Initialized, Role: FOLLOWER
I20261120 09:03:25.530741 24508 raft_consensus.cc:2062] T ab6cc162ae404f91a484d70756e3897f P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 2fb9ff0dc3d849d7bcf95806233d2c62 in term 1
I20261120 09:03:25.530747 24808 raft_consensus.cc:2062] T ab6cc162ae404f91a484d70756e3897f P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 2fb9ff0dc3d849d7bcf95806233d2c62 in term 1
I20261120 09:03:25.531368 25117 consensus_queue.cc:261] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:25.534451 24595 leader_election.cc:304] T ab6cc162ae404f91a484d70756e3897f P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62, 8668dad23e404dafb0ac25267f07bd46; no voters: 
I20261120 09:03:25.534829 24990 raft_consensus.cc:3024] T ab6cc162ae404f91a484d70756e3897f P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Leader election won for term 1
I20261120 09:03:25.535099 24990 raft_consensus.cc:744] T ab6cc162ae404f91a484d70756e3897f P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 LEADER]: Becoming Leader. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Running, Role: LEADER
I20261120 09:03:25.535424 24990 consensus_queue.cc:238] T ab6cc162ae404f91a484d70756e3897f P 2fb9ff0dc3d849d7bcf95806233d2c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:25.540867 25133 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:25.541298 25133 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:25.542501 25117 sys_catalog.cc:565] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: configured and running, proceeding with master startup.
I20261120 09:03:25.545475 25132 consensus_queue.cc:1049] T ab6cc162ae404f91a484d70756e3897f P 2fb9ff0dc3d849d7bcf95806233d2c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:25.550804 25132 consensus_queue.cc:1049] T ab6cc162ae404f91a484d70756e3897f P 2fb9ff0dc3d849d7bcf95806233d2c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:25.562148 25034 raft_consensus.cc:534] T 6130d88766ca4ced867fb83be00a00f5 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:25.562335 25034 raft_consensus.cc:556] T 6130d88766ca4ced867fb83be00a00f5 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:25.563143 25034 leader_election.cc:290] T 6130d88766ca4ced867fb83be00a00f5 P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:25.563877 24805 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "6130d88766ca4ced867fb83be00a00f5" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46" is_pre_election: true
I20261120 09:03:25.564172 24805 raft_consensus.cc:2062] T 6130d88766ca4ced867fb83be00a00f5 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 0
I20261120 09:03:25.564646 24443 leader_election.cc:304] T 6130d88766ca4ced867fb83be00a00f5 P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46; no voters: 
I20261120 09:03:25.565194 25034 raft_consensus.cc:3024] T 6130d88766ca4ced867fb83be00a00f5 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261120 09:03:25.565325 25034 raft_consensus.cc:534] T 6130d88766ca4ced867fb83be00a00f5 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261120 09:03:25.565428 25034 raft_consensus.cc:3296] T 6130d88766ca4ced867fb83be00a00f5 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:25.565732 25034 raft_consensus.cc:556] T 6130d88766ca4ced867fb83be00a00f5 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:25.569324 24660 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "6130d88766ca4ced867fb83be00a00f5" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" is_pre_election: true
I20261120 09:03:25.569617 24660 raft_consensus.cc:2062] T 6130d88766ca4ced867fb83be00a00f5 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 0
I20261120 09:03:25.570796 25034 leader_election.cc:290] T 6130d88766ca4ced867fb83be00a00f5 P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 election: Requested vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:25.571494 24805 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "6130d88766ca4ced867fb83be00a00f5" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46"
I20261120 09:03:25.571761 24805 raft_consensus.cc:3296] T 6130d88766ca4ced867fb83be00a00f5 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:25.572141 24805 raft_consensus.cc:2062] T 6130d88766ca4ced867fb83be00a00f5 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 1
I20261120 09:03:25.574344 24660 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "6130d88766ca4ced867fb83be00a00f5" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62"
I20261120 09:03:25.574592 24660 raft_consensus.cc:3296] T 6130d88766ca4ced867fb83be00a00f5 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:25.574962 24660 raft_consensus.cc:2062] T 6130d88766ca4ced867fb83be00a00f5 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 1
I20261120 09:03:25.575629 24443 leader_election.cc:304] T 6130d88766ca4ced867fb83be00a00f5 P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46; no voters: 
I20261120 09:03:25.575978 25034 raft_consensus.cc:3024] T 6130d88766ca4ced867fb83be00a00f5 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Leader election won for term 1
I20261120 09:03:25.576136 25034 raft_consensus.cc:744] T 6130d88766ca4ced867fb83be00a00f5 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 LEADER]: Becoming Leader. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Running, Role: LEADER
I20261120 09:03:25.576438 25034 consensus_queue.cc:238] T 6130d88766ca4ced867fb83be00a00f5 P 2c3fe57b9d2c424da181281af303f3c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } }
I20261120 09:03:25.603878 25133 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d82bf27d60fa450e8f941d1a9d36a825. Latest consensus state: current_term: 3 leader_uuid: "d82bf27d60fa450e8f941d1a9d36a825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:25.604230 25133 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:25.607625 24917 sys_catalog.cc:455] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "d82bf27d60fa450e8f941d1a9d36a825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:25.607892 24917 sys_catalog.cc:458] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: This master's current role is: LEADER
I20261120 09:03:25.608394 24969 consensus_queue.cc:1049] T 6130d88766ca4ced867fb83be00a00f5 P 2c3fe57b9d2c424da181281af303f3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:25.610255 24969 consensus_queue.cc:1049] T 6130d88766ca4ced867fb83be00a00f5 P 2c3fe57b9d2c424da181281af303f3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:25.622668 24316 catalog_manager.cc:3546] renamed table default.table_4bb4f7811f444da2b0eca6ab9e9203dd [id=aa6cfb171b4c482caa17d7c0862da3d0] in HMS: new name default.table_784f78c485a74606a638a81633a149e7
I20261120 09:03:25.653474 24708 heartbeater.cc:345] Connected to a master server at 127.23.79.126:41659
I20261120 09:03:25.699653 25162 catalog_manager.cc:1310] Loaded cluster ID: b96ccaeeefb845f4962e35569b62531b
I20261120 09:03:25.699770 25162 catalog_manager.cc:1603] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: loading cluster ID for follower catalog manager: success
I20261120 09:03:25.706346 24313 catalog_manager.cc:2218] created HMS catalog entry for table  [id=6a7afe82b2724dccb508eb95158c7ec7]
I20261120 09:03:25.715622 25162 catalog_manager.cc:1625] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: acquiring CA information for follower catalog manager: success
I20261120 09:03:25.716419 24313 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:41728 (request call id 24) took 2156 ms. Trace:
I20261120 09:03:25.716550 24313 rpcz_store.cc:276] 1120 09:03:23.560025 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:23.884090 (+324065us) service_pool.cc:224] Handling call
1120 09:03:24.704293 (+820203us) catalog_manager.cc:2145] Acquired catalog manager lock
1120 09:03:24.704683 (+   390us) catalog_manager.cc:2191] Created new table and tablet info
1120 09:03:25.706300 (+1001617us) catalog_manager.cc:2217] Created new table in HMS catalog
1120 09:03:25.716083 (+  9783us) catalog_manager.cc:2251] Wrote table and tablets to system table
1120 09:03:25.716211 (+   128us) catalog_manager.cc:2285] Inserted table and tablets into CatalogManager maps
1120 09:03:25.716344 (+   133us) inbound_call.cc:177] Queueing success response
Related trace 'op':
1120 09:03:25.707226 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1120 09:03:25.707354 (+   128us) write_op.cc:437] Acquiring schema lock in shared mode
1120 09:03:25.707360 (+     6us) write_op.cc:440] Acquired schema lock
1120 09:03:25.707363 (+     3us) tablet.cc:710] Decoding operations
1120 09:03:25.707457 (+    94us) write_op.cc:625] Acquiring the partition lock for write op
1120 09:03:25.707470 (+    13us) write_op.cc:646] Partition lock acquired for write op
1120 09:03:25.707476 (+     6us) tablet.cc:742] Acquiring locks for 2 operations
1120 09:03:25.707566 (+    90us) tablet.cc:758] Row locks acquired
1120 09:03:25.707568 (+     2us) write_op.cc:260] PREPARE: finished
1120 09:03:25.707608 (+    40us) write_op.cc:270] Start()
1120 09:03:25.707641 (+    33us) write_op.cc:276] Timestamp: P: 1795165405707282 usec, L: 0
1120 09:03:25.707644 (+     3us) op_driver.cc:350] REPLICATION: starting
1120 09:03:25.707828 (+   184us) log.cc:844] Serialized 432 byte log entry
1120 09:03:25.715437 (+  7609us) op_driver.cc:466] REPLICATION: finished
1120 09:03:25.715564 (+   127us) write_op.cc:301] APPLY: starting
1120 09:03:25.715583 (+    19us) tablet.cc:1451] starting BulkCheckPresence
1120 09:03:25.715632 (+    49us) tablet.cc:1454] finished BulkCheckPresence
1120 09:03:25.715658 (+    26us) tablet.cc:1456] starting ApplyRowOperation cycle
1120 09:03:25.715779 (+   121us) tablet.cc:1467] finished ApplyRowOperation cycle
1120 09:03:25.715811 (+    32us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
1120 09:03:25.715819 (+     8us) write_op.cc:312] APPLY: finished
1120 09:03:25.715899 (+    80us) log.cc:844] Serialized 28 byte log entry
1120 09:03:25.715956 (+    57us) write_op.cc:494] Releasing partition, row and schema locks
1120 09:03:25.715977 (+    21us) write_op.cc:459] Released schema lock
1120 09:03:25.715985 (+     8us) write_op.cc:346] FINISH: Updating metrics
1120 09:03:25.716058 (+    73us) write_op.cc:494] Releasing partition, row and schema locks
1120 09:03:25.716061 (+     3us) write_op.cc:459] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":917555,"Hive Metastore.run_cpu_time_us":336,"Hive Metastore.run_wall_time_us":83830,"child_traces":[["op",{"apply.queue_time_us":72,"apply.run_cpu_time_us":491,"apply.run_wall_time_us":491,"num_ops":2,"prepare.queue_time_us":71,"prepare.run_cpu_time_us":717,"prepare.run_wall_time_us":718,"raft.queue_time_us":1183,"raft.run_cpu_time_us":409,"raft.run_wall_time_us":409,"replication_time_us":7758}]]}
I20261120 09:03:25.718901 25162 catalog_manager.cc:1653] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20261120 09:03:25.733856 24788 tablet_service.cc:1495] Processing CreateTablet for tablet e4979050b3154c6292e42c8a3f7c89e7 (DEFAULT_TABLE table=default.table_f0940064a6844fdaadb8859f4257b11f [id=6a7afe82b2724dccb508eb95158c7ec7]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:25.734412 24788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4979050b3154c6292e42c8a3f7c89e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:25.738992 24490 tablet_service.cc:1495] Processing CreateTablet for tablet e4979050b3154c6292e42c8a3f7c89e7 (DEFAULT_TABLE table=default.table_f0940064a6844fdaadb8859f4257b11f [id=6a7afe82b2724dccb508eb95158c7ec7]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:25.739490 24490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4979050b3154c6292e42c8a3f7c89e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:25.742978 24315 catalog_manager.cc:2218] created HMS catalog entry for table  [id=07e09703ed284b73a0c9915d40065e82]
I20261120 09:03:25.748678 24641 tablet_service.cc:1495] Processing CreateTablet for tablet e4979050b3154c6292e42c8a3f7c89e7 (DEFAULT_TABLE table=default.table_f0940064a6844fdaadb8859f4257b11f [id=6a7afe82b2724dccb508eb95158c7ec7]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:25.749158 24641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4979050b3154c6292e42c8a3f7c89e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:25.749567 24313 catalog_manager.cc:5856] T 6130d88766ca4ced867fb83be00a00f5 P 2fb9ff0dc3d849d7bcf95806233d2c62 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65). New cstate: current_term: 1 leader_uuid: "2c3fe57b9d2c424da181281af303f3c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } }
I20261120 09:03:25.750130 24313 catalog_manager.cc:5856] T ab6cc162ae404f91a484d70756e3897f P 2fb9ff0dc3d849d7bcf95806233d2c62 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66). New cstate: current_term: 1 leader_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } health_report { overall_health: HEALTHY } } }
I20261120 09:03:25.755040 25124 tablet_bootstrap.cc:492] T e4979050b3154c6292e42c8a3f7c89e7 P 8668dad23e404dafb0ac25267f07bd46: Bootstrap starting.
I20261120 09:03:25.756867 25124 tablet_bootstrap.cc:654] T e4979050b3154c6292e42c8a3f7c89e7 P 8668dad23e404dafb0ac25267f07bd46: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:25.759025 25125 tablet_bootstrap.cc:492] T e4979050b3154c6292e42c8a3f7c89e7 P 2c3fe57b9d2c424da181281af303f3c3: Bootstrap starting.
I20261120 09:03:25.760761 25125 tablet_bootstrap.cc:654] T e4979050b3154c6292e42c8a3f7c89e7 P 2c3fe57b9d2c424da181281af303f3c3: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:25.761904 25123 tablet_bootstrap.cc:492] T e4979050b3154c6292e42c8a3f7c89e7 P 2fb9ff0dc3d849d7bcf95806233d2c62: Bootstrap starting.
I20261120 09:03:25.763947 25123 tablet_bootstrap.cc:654] T e4979050b3154c6292e42c8a3f7c89e7 P 2fb9ff0dc3d849d7bcf95806233d2c62: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:25.767385 25124 tablet_bootstrap.cc:492] T e4979050b3154c6292e42c8a3f7c89e7 P 8668dad23e404dafb0ac25267f07bd46: No bootstrap required, opened a new log
I20261120 09:03:25.767535 25124 ts_tablet_manager.cc:1449] T e4979050b3154c6292e42c8a3f7c89e7 P 8668dad23e404dafb0ac25267f07bd46: Time spent bootstrapping tablet: real 0.013s	user 0.002s	sys 0.001s
I20261120 09:03:25.768271 25124 raft_consensus.cc:366] T e4979050b3154c6292e42c8a3f7c89e7 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:25.768451 25124 raft_consensus.cc:392] T e4979050b3154c6292e42c8a3f7c89e7 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:25.768535 25124 raft_consensus.cc:787] T e4979050b3154c6292e42c8a3f7c89e7 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Initialized, Role: FOLLOWER
I20261120 09:03:25.768713 24315 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:41728 (request call id 21) took 2343 ms. Trace:
I20261120 09:03:25.768741 25124 consensus_queue.cc:261] T e4979050b3154c6292e42c8a3f7c89e7 P 8668dad23e404dafb0ac25267f07bd46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:25.769276 25124 ts_tablet_manager.cc:1480] T e4979050b3154c6292e42c8a3f7c89e7 P 8668dad23e404dafb0ac25267f07bd46: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.001s
I20261120 09:03:25.768847 24315 rpcz_store.cc:276] 1120 09:03:23.425065 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:23.726834 (+301769us) service_pool.cc:224] Handling call
1120 09:03:24.705200 (+978366us) catalog_manager.cc:2145] Acquired catalog manager lock
1120 09:03:24.705688 (+   488us) catalog_manager.cc:2191] Created new table and tablet info
1120 09:03:25.742931 (+1037243us) catalog_manager.cc:2217] Created new table in HMS catalog
1120 09:03:25.768308 (+ 25377us) catalog_manager.cc:2251] Wrote table and tablets to system table
1120 09:03:25.768471 (+   163us) catalog_manager.cc:2285] Inserted table and tablets into CatalogManager maps
1120 09:03:25.768628 (+   157us) inbound_call.cc:177] Queueing success response
Related trace 'op':
1120 09:03:25.744339 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1120 09:03:25.744486 (+   147us) write_op.cc:437] Acquiring schema lock in shared mode
1120 09:03:25.744505 (+    19us) write_op.cc:440] Acquired schema lock
1120 09:03:25.744508 (+     3us) tablet.cc:710] Decoding operations
1120 09:03:25.744614 (+   106us) write_op.cc:625] Acquiring the partition lock for write op
1120 09:03:25.744629 (+    15us) write_op.cc:646] Partition lock acquired for write op
1120 09:03:25.744635 (+     6us) tablet.cc:742] Acquiring locks for 2 operations
1120 09:03:25.744726 (+    91us) tablet.cc:758] Row locks acquired
1120 09:03:25.744728 (+     2us) write_op.cc:260] PREPARE: finished
1120 09:03:25.744771 (+    43us) write_op.cc:270] Start()
1120 09:03:25.744808 (+    37us) write_op.cc:276] Timestamp: P: 1795165405744438 usec, L: 0
1120 09:03:25.744812 (+     4us) op_driver.cc:350] REPLICATION: starting
1120 09:03:25.745015 (+   203us) log.cc:844] Serialized 432 byte log entry
1120 09:03:25.764127 (+ 19112us) op_driver.cc:466] REPLICATION: finished
1120 09:03:25.766134 (+  2007us) write_op.cc:301] APPLY: starting
1120 09:03:25.766164 (+    30us) tablet.cc:1451] starting BulkCheckPresence
1120 09:03:25.766227 (+    63us) tablet.cc:1454] finished BulkCheckPresence
1120 09:03:25.766335 (+   108us) tablet.cc:1456] starting ApplyRowOperation cycle
1120 09:03:25.766920 (+   585us) tablet.cc:1467] finished ApplyRowOperation cycle
1120 09:03:25.766982 (+    62us) tablet_metrics.cc:626] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
1120 09:03:25.767013 (+    31us) write_op.cc:312] APPLY: finished
1120 09:03:25.767131 (+   118us) log.cc:844] Serialized 28 byte log entry
1120 09:03:25.767218 (+    87us) write_op.cc:494] Releasing partition, row and schema locks
1120 09:03:25.767246 (+    28us) write_op.cc:459] Released schema lock
1120 09:03:25.767269 (+    23us) write_op.cc:346] FINISH: Updating metrics
1120 09:03:25.767370 (+   101us) write_op.cc:494] Releasing partition, row and schema locks
1120 09:03:25.767376 (+     6us) write_op.cc:459] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1000402,"Hive Metastore.run_cpu_time_us":272,"Hive Metastore.run_wall_time_us":36608,"child_traces":[["op",{"apply.queue_time_us":1909,"apply.run_cpu_time_us":879,"apply.run_wall_time_us":1236,"num_ops":2,"prepare.queue_time_us":632,"prepare.run_cpu_time_us":764,"prepare.run_wall_time_us":763,"replication_time_us":19267}]]}
I20261120 09:03:25.775661 25082 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" instance_seqno: 1795165402395308) as {username='slave'} at 127.23.79.67:50539; Asking this server to re-register.
I20261120 09:03:25.776743 24855 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:25.778055 25123 tablet_bootstrap.cc:492] T e4979050b3154c6292e42c8a3f7c89e7 P 2fb9ff0dc3d849d7bcf95806233d2c62: No bootstrap required, opened a new log
I20261120 09:03:25.778205 25123 ts_tablet_manager.cc:1449] T e4979050b3154c6292e42c8a3f7c89e7 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20261120 09:03:25.778981 25123 raft_consensus.cc:366] T e4979050b3154c6292e42c8a3f7c89e7 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:25.779170 25123 raft_consensus.cc:392] T e4979050b3154c6292e42c8a3f7c89e7 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:25.779284 25123 raft_consensus.cc:787] T e4979050b3154c6292e42c8a3f7c89e7 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Initialized, Role: FOLLOWER
I20261120 09:03:25.779521 25123 consensus_queue.cc:261] T e4979050b3154c6292e42c8a3f7c89e7 P 2fb9ff0dc3d849d7bcf95806233d2c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:25.779914 25082 ts_manager.cc:210] Registered new tserver with Master: 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:25.783708 25125 tablet_bootstrap.cc:492] T e4979050b3154c6292e42c8a3f7c89e7 P 2c3fe57b9d2c424da181281af303f3c3: No bootstrap required, opened a new log
I20261120 09:03:25.783897 25125 ts_tablet_manager.cc:1449] T e4979050b3154c6292e42c8a3f7c89e7 P 2c3fe57b9d2c424da181281af303f3c3: Time spent bootstrapping tablet: real 0.025s	user 0.003s	sys 0.000s
I20261120 09:03:25.784669 25125 raft_consensus.cc:366] T e4979050b3154c6292e42c8a3f7c89e7 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:25.784857 25125 raft_consensus.cc:392] T e4979050b3154c6292e42c8a3f7c89e7 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:25.784967 25125 raft_consensus.cc:787] T e4979050b3154c6292e42c8a3f7c89e7 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Initialized, Role: FOLLOWER
I20261120 09:03:25.785166 25125 consensus_queue.cc:261] T e4979050b3154c6292e42c8a3f7c89e7 P 2c3fe57b9d2c424da181281af303f3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:25.785696 25125 ts_tablet_manager.cc:1480] T e4979050b3154c6292e42c8a3f7c89e7 P 2c3fe57b9d2c424da181281af303f3c3: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.000s
I20261120 09:03:25.787597 25123 ts_tablet_manager.cc:1480] T e4979050b3154c6292e42c8a3f7c89e7 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.000s
I20261120 09:03:25.787760 25081 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" instance_seqno: 1795165401905746) as {username='slave'} at 127.23.79.66:49939; Asking this server to re-register.
I20261120 09:03:25.788697 24708 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:25.790496 25081 ts_manager.cc:210] Registered new tserver with Master: 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879)
I20261120 09:03:25.792287 24568 heartbeater.cc:345] Connected to a master server at 127.23.79.126:41659
I20261120 09:03:25.795039 25081 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" instance_seqno: 1795165401200304) as {username='slave'} at 127.23.79.65:57931; Asking this server to re-register.
I20261120 09:03:25.796003 24568 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:25.800117 25080 ts_manager.cc:210] Registered new tserver with Master: 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:25.845021 24788 tablet_service.cc:1495] Processing CreateTablet for tablet bf5c1cdd4f5c4ce6b89f099b65629910 (DEFAULT_TABLE table=default.table_797fe36dbbf14c0c8e085d8470e75a24 [id=07e09703ed284b73a0c9915d40065e82]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:25.845532 24788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf5c1cdd4f5c4ce6b89f099b65629910. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:25.845510 24315 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41728:
name: "default.Table_f2fb9ef502034f008e49c58af534c051"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:25.846405 24313 catalog_manager.cc:2551] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41728:
table { table_name: "default.Table_d67fc59080cc4194b566604a649aefad" } modify_external_catalogs: true
I20261120 09:03:25.846611 24313 catalog_manager.cc:2799] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41728:
table { table_name: "default.Table_d67fc59080cc4194b566604a649aefad" } modify_external_catalogs: true
I20261120 09:03:25.847775 24490 tablet_service.cc:1495] Processing CreateTablet for tablet bf5c1cdd4f5c4ce6b89f099b65629910 (DEFAULT_TABLE table=default.table_797fe36dbbf14c0c8e085d8470e75a24 [id=07e09703ed284b73a0c9915d40065e82]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:25.848275 24490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf5c1cdd4f5c4ce6b89f099b65629910. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:25.851065 24641 tablet_service.cc:1495] Processing CreateTablet for tablet bf5c1cdd4f5c4ce6b89f099b65629910 (DEFAULT_TABLE table=default.table_797fe36dbbf14c0c8e085d8470e75a24 [id=07e09703ed284b73a0c9915d40065e82]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:25.851586 24641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf5c1cdd4f5c4ce6b89f099b65629910. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:25.855940 25124 tablet_bootstrap.cc:492] T bf5c1cdd4f5c4ce6b89f099b65629910 P 8668dad23e404dafb0ac25267f07bd46: Bootstrap starting.
I20261120 09:03:25.857496 25124 tablet_bootstrap.cc:654] T bf5c1cdd4f5c4ce6b89f099b65629910 P 8668dad23e404dafb0ac25267f07bd46: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:25.857564 25123 tablet_bootstrap.cc:492] T bf5c1cdd4f5c4ce6b89f099b65629910 P 2fb9ff0dc3d849d7bcf95806233d2c62: Bootstrap starting.
I20261120 09:03:25.859342 25123 tablet_bootstrap.cc:654] T bf5c1cdd4f5c4ce6b89f099b65629910 P 2fb9ff0dc3d849d7bcf95806233d2c62: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:25.864745 25125 tablet_bootstrap.cc:492] T bf5c1cdd4f5c4ce6b89f099b65629910 P 2c3fe57b9d2c424da181281af303f3c3: Bootstrap starting.
I20261120 09:03:25.867105 25125 tablet_bootstrap.cc:654] T bf5c1cdd4f5c4ce6b89f099b65629910 P 2c3fe57b9d2c424da181281af303f3c3: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:25.868194 24990 raft_consensus.cc:534] T e4979050b3154c6292e42c8a3f7c89e7 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:25.868429 24990 raft_consensus.cc:556] T e4979050b3154c6292e42c8a3f7c89e7 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:25.869230 24990 leader_election.cc:290] T e4979050b3154c6292e42c8a3f7c89e7 P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:25.870561 24508 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "e4979050b3154c6292e42c8a3f7c89e7" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3" is_pre_election: true
I20261120 09:03:25.870797 24508 raft_consensus.cc:2062] T e4979050b3154c6292e42c8a3f7c89e7 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 2fb9ff0dc3d849d7bcf95806233d2c62 in term 0
I20261120 09:03:25.871445 24808 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "e4979050b3154c6292e42c8a3f7c89e7" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46" is_pre_election: true
I20261120 09:03:25.871755 24808 raft_consensus.cc:2062] T e4979050b3154c6292e42c8a3f7c89e7 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 2fb9ff0dc3d849d7bcf95806233d2c62 in term 0
I20261120 09:03:25.872406 24595 leader_election.cc:304] T e4979050b3154c6292e42c8a3f7c89e7 P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62, 8668dad23e404dafb0ac25267f07bd46; no voters: 
I20261120 09:03:25.872967 24990 raft_consensus.cc:3024] T e4979050b3154c6292e42c8a3f7c89e7 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261120 09:03:25.873082 24990 raft_consensus.cc:534] T e4979050b3154c6292e42c8a3f7c89e7 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261120 09:03:25.873191 24990 raft_consensus.cc:3296] T e4979050b3154c6292e42c8a3f7c89e7 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:25.873435 24990 raft_consensus.cc:556] T e4979050b3154c6292e42c8a3f7c89e7 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:25.875434 25123 tablet_bootstrap.cc:492] T bf5c1cdd4f5c4ce6b89f099b65629910 P 2fb9ff0dc3d849d7bcf95806233d2c62: No bootstrap required, opened a new log
I20261120 09:03:25.875576 25123 ts_tablet_manager.cc:1449] T bf5c1cdd4f5c4ce6b89f099b65629910 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.002s
I20261120 09:03:25.876305 25123 raft_consensus.cc:366] T bf5c1cdd4f5c4ce6b89f099b65629910 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } }
I20261120 09:03:25.876471 25123 raft_consensus.cc:392] T bf5c1cdd4f5c4ce6b89f099b65629910 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:25.876539 25123 raft_consensus.cc:787] T bf5c1cdd4f5c4ce6b89f099b65629910 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Initialized, Role: FOLLOWER
I20261120 09:03:25.876827 24990 leader_election.cc:290] T e4979050b3154c6292e42c8a3f7c89e7 P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 election: Requested vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:25.877926 24508 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "e4979050b3154c6292e42c8a3f7c89e7" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3"
I20261120 09:03:25.878120 24508 raft_consensus.cc:3296] T e4979050b3154c6292e42c8a3f7c89e7 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:25.878450 24508 raft_consensus.cc:2062] T e4979050b3154c6292e42c8a3f7c89e7 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 2fb9ff0dc3d849d7bcf95806233d2c62 in term 1
I20261120 09:03:25.881865 24808 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "e4979050b3154c6292e42c8a3f7c89e7" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46"
I20261120 09:03:25.882053 24808 raft_consensus.cc:3296] T e4979050b3154c6292e42c8a3f7c89e7 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:25.882355 24808 raft_consensus.cc:2062] T e4979050b3154c6292e42c8a3f7c89e7 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 2fb9ff0dc3d849d7bcf95806233d2c62 in term 1
I20261120 09:03:25.882918 24595 leader_election.cc:304] T e4979050b3154c6292e42c8a3f7c89e7 P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 
I20261120 09:03:25.883230 24990 raft_consensus.cc:3024] T e4979050b3154c6292e42c8a3f7c89e7 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Leader election won for term 1
I20261120 09:03:25.883364 24990 raft_consensus.cc:744] T e4979050b3154c6292e42c8a3f7c89e7 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 LEADER]: Becoming Leader. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Running, Role: LEADER
I20261120 09:03:25.883627 24990 consensus_queue.cc:238] T e4979050b3154c6292e42c8a3f7c89e7 P 2fb9ff0dc3d849d7bcf95806233d2c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:25.885906 25123 consensus_queue.cc:261] T bf5c1cdd4f5c4ce6b89f099b65629910 P 2fb9ff0dc3d849d7bcf95806233d2c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } }
I20261120 09:03:25.887295 25123 ts_tablet_manager.cc:1480] T bf5c1cdd4f5c4ce6b89f099b65629910 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.001s
I20261120 09:03:25.889665 25124 tablet_bootstrap.cc:492] T bf5c1cdd4f5c4ce6b89f099b65629910 P 8668dad23e404dafb0ac25267f07bd46: No bootstrap required, opened a new log
I20261120 09:03:25.889882 25124 ts_tablet_manager.cc:1449] T bf5c1cdd4f5c4ce6b89f099b65629910 P 8668dad23e404dafb0ac25267f07bd46: Time spent bootstrapping tablet: real 0.034s	user 0.004s	sys 0.004s
I20261120 09:03:25.890831 25124 raft_consensus.cc:366] T bf5c1cdd4f5c4ce6b89f099b65629910 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } }
I20261120 09:03:25.891054 25124 raft_consensus.cc:392] T bf5c1cdd4f5c4ce6b89f099b65629910 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:25.891167 25124 raft_consensus.cc:787] T bf5c1cdd4f5c4ce6b89f099b65629910 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Initialized, Role: FOLLOWER
I20261120 09:03:25.891965 25124 consensus_queue.cc:261] T bf5c1cdd4f5c4ce6b89f099b65629910 P 8668dad23e404dafb0ac25267f07bd46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } }
I20261120 09:03:25.901454 25124 ts_tablet_manager.cc:1480] T bf5c1cdd4f5c4ce6b89f099b65629910 P 8668dad23e404dafb0ac25267f07bd46: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.000s
I20261120 09:03:25.935428 25125 tablet_bootstrap.cc:492] T bf5c1cdd4f5c4ce6b89f099b65629910 P 2c3fe57b9d2c424da181281af303f3c3: No bootstrap required, opened a new log
I20261120 09:03:25.935658 25125 ts_tablet_manager.cc:1449] T bf5c1cdd4f5c4ce6b89f099b65629910 P 2c3fe57b9d2c424da181281af303f3c3: Time spent bootstrapping tablet: real 0.071s	user 0.002s	sys 0.009s
I20261120 09:03:25.936479 25125 raft_consensus.cc:366] T bf5c1cdd4f5c4ce6b89f099b65629910 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } }
I20261120 09:03:25.936685 25125 raft_consensus.cc:392] T bf5c1cdd4f5c4ce6b89f099b65629910 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:25.936774 25125 raft_consensus.cc:787] T bf5c1cdd4f5c4ce6b89f099b65629910 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Initialized, Role: FOLLOWER
I20261120 09:03:25.937062 25125 consensus_queue.cc:261] T bf5c1cdd4f5c4ce6b89f099b65629910 P 2c3fe57b9d2c424da181281af303f3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } }
I20261120 09:03:25.939224 25125 ts_tablet_manager.cc:1480] T bf5c1cdd4f5c4ce6b89f099b65629910 P 2c3fe57b9d2c424da181281af303f3c3: Time spent starting tablet: real 0.003s	user 0.000s	sys 0.003s
I20261120 09:03:25.942126 25178 raft_consensus.cc:534] T bf5c1cdd4f5c4ce6b89f099b65629910 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:25.942306 25178 raft_consensus.cc:556] T bf5c1cdd4f5c4ce6b89f099b65629910 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } }
I20261120 09:03:25.943872 24660 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "bf5c1cdd4f5c4ce6b89f099b65629910" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" is_pre_election: true
I20261120 09:03:25.944154 24660 raft_consensus.cc:2062] T bf5c1cdd4f5c4ce6b89f099b65629910 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 8668dad23e404dafb0ac25267f07bd46 in term 0
I20261120 09:03:25.944583 24744 leader_election.cc:304] T bf5c1cdd4f5c4ce6b89f099b65629910 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62, 8668dad23e404dafb0ac25267f07bd46; no voters: 
I20261120 09:03:25.945043 25178 leader_election.cc:290] T bf5c1cdd4f5c4ce6b89f099b65629910 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677), 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879)
I20261120 09:03:25.945201 25178 raft_consensus.cc:3024] T bf5c1cdd4f5c4ce6b89f099b65629910 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261120 09:03:25.945302 25178 raft_consensus.cc:534] T bf5c1cdd4f5c4ce6b89f099b65629910 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261120 09:03:25.945413 25178 raft_consensus.cc:3296] T bf5c1cdd4f5c4ce6b89f099b65629910 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:25.945454 25142 consensus_queue.cc:1049] T e4979050b3154c6292e42c8a3f7c89e7 P 2fb9ff0dc3d849d7bcf95806233d2c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:25.945717 25178 raft_consensus.cc:556] T bf5c1cdd4f5c4ce6b89f099b65629910 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } }
I20261120 09:03:25.957026 25142 consensus_queue.cc:1049] T e4979050b3154c6292e42c8a3f7c89e7 P 2fb9ff0dc3d849d7bcf95806233d2c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:25.976804 25178 leader_election.cc:290] T bf5c1cdd4f5c4ce6b89f099b65629910 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 election: Requested vote from peers 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677), 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879)
I20261120 09:03:25.977716 24660 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "bf5c1cdd4f5c4ce6b89f099b65629910" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62"
I20261120 09:03:25.977973 24660 raft_consensus.cc:3296] T bf5c1cdd4f5c4ce6b89f099b65629910 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:25.978358 24660 raft_consensus.cc:2062] T bf5c1cdd4f5c4ce6b89f099b65629910 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 8668dad23e404dafb0ac25267f07bd46 in term 1
I20261120 09:03:25.990649 24744 leader_election.cc:304] T bf5c1cdd4f5c4ce6b89f099b65629910 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62, 8668dad23e404dafb0ac25267f07bd46; no voters: 
I20261120 09:03:25.991060 25181 raft_consensus.cc:3024] T bf5c1cdd4f5c4ce6b89f099b65629910 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Leader election won for term 1
I20261120 09:03:25.991225 25181 raft_consensus.cc:744] T bf5c1cdd4f5c4ce6b89f099b65629910 P 8668dad23e404dafb0ac25267f07bd46 [term 1 LEADER]: Becoming Leader. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Running, Role: LEADER
I20261120 09:03:25.991536 25181 consensus_queue.cc:238] T bf5c1cdd4f5c4ce6b89f099b65629910 P 8668dad23e404dafb0ac25267f07bd46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } }
W20261120 09:03:26.003790 24742 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.79.65:40677, user_credentials={real_user=slave}} blocked reactor thread for 84378us
I20261120 09:03:26.004621 24509 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "bf5c1cdd4f5c4ce6b89f099b65629910" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3" is_pre_election: true
I20261120 09:03:26.004944 24509 raft_consensus.cc:2062] T bf5c1cdd4f5c4ce6b89f099b65629910 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 8668dad23e404dafb0ac25267f07bd46 in term 0
I20261120 09:03:26.007560 25020 consensus_queue.cc:1049] T bf5c1cdd4f5c4ce6b89f099b65629910 P 8668dad23e404dafb0ac25267f07bd46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:26.020467 24508 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "bf5c1cdd4f5c4ce6b89f099b65629910" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3"
I20261120 09:03:26.020720 24508 raft_consensus.cc:3296] T bf5c1cdd4f5c4ce6b89f099b65629910 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:26.027179 24508 raft_consensus.cc:2062] T bf5c1cdd4f5c4ce6b89f099b65629910 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 8668dad23e404dafb0ac25267f07bd46 in term 1
I20261120 09:03:26.027693 25020 consensus_queue.cc:1049] T bf5c1cdd4f5c4ce6b89f099b65629910 P 8668dad23e404dafb0ac25267f07bd46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:26.351099 25187 raft_consensus.cc:534] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d82bf27d60fa450e8f941d1a9d36a825)
I20261120 09:03:26.351478 25187 raft_consensus.cc:556] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:26.354815 25187 leader_election.cc:290] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319), d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881)
I20261120 09:03:26.354934 24330 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a99947e985094a3e8999fe2aa4e23f18" candidate_term: 4 candidate_status { last_received { term: 3 index: 52 } } ignore_live_leader: false dest_uuid: "d82bf27d60fa450e8f941d1a9d36a825" is_pre_election: true
I20261120 09:03:26.360081 25186 raft_consensus.cc:534] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d82bf27d60fa450e8f941d1a9d36a825)
I20261120 09:03:26.360666 24260 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a99947e985094a3e8999fe2aa4e23f18" candidate_term: 4 candidate_status { last_received { term: 3 index: 52 } } ignore_live_leader: false dest_uuid: "d2b1940991ac40bd916579d581e689f4" is_pre_election: true
I20261120 09:03:26.361158 25186 raft_consensus.cc:556] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:26.361548 24260 raft_consensus.cc:2062] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 3 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate a99947e985094a3e8999fe2aa4e23f18 in term 3
I20261120 09:03:26.362161 25057 leader_election.cc:304] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4; no voters: d82bf27d60fa450e8f941d1a9d36a825
I20261120 09:03:26.362990 25187 raft_consensus.cc:3024] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20261120 09:03:26.363189 25187 raft_consensus.cc:534] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d82bf27d60fa450e8f941d1a9d36a825)
I20261120 09:03:26.363354 25187 raft_consensus.cc:3296] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 3 FOLLOWER]: Advancing to term 4
I20261120 09:03:26.395316 25186 leader_election.cc:290] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881)
I20261120 09:03:26.395973 24330 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d2b1940991ac40bd916579d581e689f4" candidate_term: 4 candidate_status { last_received { term: 3 index: 52 } } ignore_live_leader: false dest_uuid: "d82bf27d60fa450e8f941d1a9d36a825" is_pre_election: true
I20261120 09:03:26.414332 25187 raft_consensus.cc:556] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:26.433264 25092 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d2b1940991ac40bd916579d581e689f4" candidate_term: 4 candidate_status { last_received { term: 3 index: 52 } } ignore_live_leader: false dest_uuid: "a99947e985094a3e8999fe2aa4e23f18" is_pre_election: true
I20261120 09:03:26.433799 25092 raft_consensus.cc:2628] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2b1940991ac40bd916579d581e689f4 in current term 4: Already voted for candidate a99947e985094a3e8999fe2aa4e23f18 in this term.
I20261120 09:03:26.434557 24238 leader_election.cc:304] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2b1940991ac40bd916579d581e689f4; no voters: a99947e985094a3e8999fe2aa4e23f18, d82bf27d60fa450e8f941d1a9d36a825
I20261120 09:03:26.435063 25186 raft_consensus.cc:3296] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 3 FOLLOWER]: Advancing to term 4
I20261120 09:03:26.440054 25186 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20261120 09:03:26.449543 25187 leader_election.cc:290] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 4 election: Requested vote from peers d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319), d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881)
I20261120 09:03:26.450004 24260 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a99947e985094a3e8999fe2aa4e23f18" candidate_term: 4 candidate_status { last_received { term: 3 index: 52 } } ignore_live_leader: false dest_uuid: "d2b1940991ac40bd916579d581e689f4"
I20261120 09:03:26.450544 24260 raft_consensus.cc:2062] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 4 FOLLOWER]: Leader election vote request: granting yes vote for candidate a99947e985094a3e8999fe2aa4e23f18 in term 4
I20261120 09:03:26.451141 24330 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a99947e985094a3e8999fe2aa4e23f18" candidate_term: 4 candidate_status { last_received { term: 3 index: 52 } } ignore_live_leader: false dest_uuid: "d82bf27d60fa450e8f941d1a9d36a825"
I20261120 09:03:26.454221 25057 leader_election.cc:304] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4; no voters: d82bf27d60fa450e8f941d1a9d36a825
I20261120 09:03:26.454437 25092 raft_consensus.cc:1303] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 4 FOLLOWER]: Rejecting Update request from peer d82bf27d60fa450e8f941d1a9d36a825 for earlier term 3. Current term is 4. Ops: []
I20261120 09:03:26.454967 25187 raft_consensus.cc:3024] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 4 FOLLOWER]: Leader election won for term 4
I20261120 09:03:26.455130 25187 raft_consensus.cc:744] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 4 LEADER]: Becoming Leader. State: Replica: a99947e985094a3e8999fe2aa4e23f18, State: Running, Role: LEADER
I20261120 09:03:26.455777 25187 consensus_queue.cc:238] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 52, Committed index: 52, Last appended: 3.52, Last appended by leader: 52, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:26.458088 25188 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a99947e985094a3e8999fe2aa4e23f18. Latest consensus state: current_term: 4 leader_uuid: "a99947e985094a3e8999fe2aa4e23f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:26.458308 25188 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: This master's current role is: LEADER
I20261120 09:03:26.462451 25191 consensus_queue.cc:1060] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 }, Status: INVALID_TERM, Last received: 3.52, Next index: 53, Last known committed idx: 52, Time since last communication: 0.000s
I20261120 09:03:26.468459 24260 raft_consensus.cc:1338] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 4 FOLLOWER]: Refusing update from remote peer a99947e985094a3e8999fe2aa4e23f18: Log matching property violated. Preceding OpId in replica: term: 3 index: 52. Preceding OpId from leader: term: 4 index: 53. (index mismatch)
I20261120 09:03:26.469440 25193 consensus_queue.cc:1049] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 53, Last known committed idx: 52, Time since last communication: 0.000s
I20261120 09:03:26.470858 25186 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a99947e985094a3e8999fe2aa4e23f18. Latest consensus state: current_term: 4 leader_uuid: "a99947e985094a3e8999fe2aa4e23f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:26.471086 25186 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:26.481130 24330 raft_consensus.cc:3291] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 3 LEADER]: Stepping down as leader of term 3
I20261120 09:03:26.481256 24330 raft_consensus.cc:787] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d82bf27d60fa450e8f941d1a9d36a825, State: Running, Role: LEADER
I20261120 09:03:26.481115 25186 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "a99947e985094a3e8999fe2aa4e23f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:26.481563 24330 consensus_queue.cc:261] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 52, Committed index: 52, Last appended: 3.52, Last appended by leader: 52, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:26.481714 25186 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:26.482816 25187 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "a99947e985094a3e8999fe2aa4e23f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:26.483081 25187 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: This master's current role is: LEADER
I20261120 09:03:26.483264 25195 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261120 09:03:26.483318 24330 raft_consensus.cc:3296] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 3 FOLLOWER]: Advancing to term 4
I20261120 09:03:26.483680 24330 raft_consensus.cc:1338] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 4 FOLLOWER]: Refusing update from remote peer a99947e985094a3e8999fe2aa4e23f18: Log matching property violated. Preceding OpId in replica: term: 3 index: 52. Preceding OpId from leader: term: 4 index: 53. (index mismatch)
I20261120 09:03:26.486766 25195 catalog_manager.cc:694] Loaded metadata for table default.table_797fe36dbbf14c0c8e085d8470e75a24 [id=07e09703ed284b73a0c9915d40065e82]
I20261120 09:03:26.487339 25195 catalog_manager.cc:694] Loaded metadata for table default.table_b2351eb1045a47feb0ca7b7422706581 [id=268c82ae3c7448059e7674f73aad3114]
I20261120 09:03:26.487787 25195 catalog_manager.cc:694] Loaded metadata for table default.table_3fae2942cff544c29c926cc5ed10a06c [id=315bdedf9fe44e5d866534884f65f6d4]
I20261120 09:03:26.488372 25195 catalog_manager.cc:694] Loaded metadata for table default.table_b9d5ad28fd144956bd0715d85a6db556 [id=33f431752a024c38910eb2e3d135295a]
I20261120 09:03:26.488781 25195 catalog_manager.cc:694] Loaded metadata for table default.table_b329d3b2bb9a409b9290011073304555 [id=3f913310fd9a49b6b264540325c0139e]
I20261120 09:03:26.489256 25195 catalog_manager.cc:694] Loaded metadata for table default.table_f0940064a6844fdaadb8859f4257b11f [id=6a7afe82b2724dccb508eb95158c7ec7]
I20261120 09:03:26.490574 25195 catalog_manager.cc:694] Loaded metadata for table default.table_67a0134c1cdf49a49bea9d4b2818b558 [id=7510ae7af246485ca9d5b539b3f90bbb]
I20261120 09:03:26.491524 25195 catalog_manager.cc:694] Loaded metadata for table default.table_d5638af53ccf40f2b367cf74de29e633 [id=83bafe99e25046a4a43a3739a3ca07a1]
I20261120 09:03:26.491986 25195 catalog_manager.cc:694] Loaded metadata for table default.table_eb77729285254174a498bb17a0adceea [id=90570e46cebe47eba97e5b980f23e909]
I20261120 09:03:26.492581 25195 catalog_manager.cc:694] Loaded metadata for table default.table_d68821f474e040e18b4d91fbbd850863 [id=9d133f08f71d42b89628f2869cbaa424]
I20261120 09:03:26.492548 25187 consensus_queue.cc:1049] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 53, Last known committed idx: 52, Time since last communication: 0.000s
I20261120 09:03:26.493129 25195 catalog_manager.cc:694] Loaded metadata for table default.table_4bb4f7811f444da2b0eca6ab9e9203dd [id=aa6cfb171b4c482caa17d7c0862da3d0]
I20261120 09:03:26.497495 25195 catalog_manager.cc:694] Loaded metadata for table default.table_39131cc9c462405ba3639c841ebfe256 [id=cb55967ea90e43be8da1354763f7984c]
I20261120 09:03:26.498042 25195 catalog_manager.cc:694] Loaded metadata for table default.table_d67fc59080cc4194b566604a649aefad [id=ec464d0cd5ec4ec2bc03ebb8a14481e0]
I20261120 09:03:26.498554 25195 catalog_manager.cc:694] Loaded metadata for table default.table_c97aaa8fd7f446ed8008a6bcecc8b494 [id=f94e62db1de54fcf92c9c893f1a073cf]
I20261120 09:03:26.502950 25195 tablet_loader.cc:96] loaded metadata for tablet 060080d353484c3a85560b493214e484 (table default.table_d5638af53ccf40f2b367cf74de29e633 [id=83bafe99e25046a4a43a3739a3ca07a1])
I20261120 09:03:26.503484 25195 tablet_loader.cc:96] loaded metadata for tablet 6130d88766ca4ced867fb83be00a00f5 (table default.table_67a0134c1cdf49a49bea9d4b2818b558 [id=7510ae7af246485ca9d5b539b3f90bbb])
I20261120 09:03:26.504153 25195 tablet_loader.cc:96] loaded metadata for tablet 707757cc32af4fe98d4a04e6a7498c17 (table default.table_eb77729285254174a498bb17a0adceea [id=90570e46cebe47eba97e5b980f23e909])
I20261120 09:03:26.504613 25195 tablet_loader.cc:96] loaded metadata for tablet 75e156478a8a470ba5f4942cd8e6a89e (table default.table_3fae2942cff544c29c926cc5ed10a06c [id=315bdedf9fe44e5d866534884f65f6d4])
I20261120 09:03:26.505524 25195 tablet_loader.cc:96] loaded metadata for tablet 8155295b7e8e40ddaedeb2e9c24f1245 (table default.table_b2351eb1045a47feb0ca7b7422706581 [id=268c82ae3c7448059e7674f73aad3114])
I20261120 09:03:26.505971 25195 tablet_loader.cc:96] loaded metadata for tablet 8732692e59194cdabba0578275da133b (table default.table_39131cc9c462405ba3639c841ebfe256 [id=cb55967ea90e43be8da1354763f7984c])
I20261120 09:03:26.506376 25195 tablet_loader.cc:96] loaded metadata for tablet a27e6c05e40742d4ab0116c2e22cd4ba (table default.table_4bb4f7811f444da2b0eca6ab9e9203dd [id=aa6cfb171b4c482caa17d7c0862da3d0])
I20261120 09:03:26.506799 25195 tablet_loader.cc:96] loaded metadata for tablet a48b8166531548208bf3ae77f7380555 (table default.table_d67fc59080cc4194b566604a649aefad [id=ec464d0cd5ec4ec2bc03ebb8a14481e0])
I20261120 09:03:26.507205 25195 tablet_loader.cc:96] loaded metadata for tablet a8cf83af75c745dc96cb98f99cd2335d (table default.table_c97aaa8fd7f446ed8008a6bcecc8b494 [id=f94e62db1de54fcf92c9c893f1a073cf])
I20261120 09:03:26.507830 25195 tablet_loader.cc:96] loaded metadata for tablet ab6cc162ae404f91a484d70756e3897f (table default.table_b329d3b2bb9a409b9290011073304555 [id=3f913310fd9a49b6b264540325c0139e])
I20261120 09:03:26.508921 25195 tablet_loader.cc:96] loaded metadata for tablet be76b618f4f142849d785428cd83c0f5 (table default.table_b9d5ad28fd144956bd0715d85a6db556 [id=33f431752a024c38910eb2e3d135295a])
I20261120 09:03:26.509341 25195 tablet_loader.cc:96] loaded metadata for tablet bf5c1cdd4f5c4ce6b89f099b65629910 (table default.table_797fe36dbbf14c0c8e085d8470e75a24 [id=07e09703ed284b73a0c9915d40065e82])
I20261120 09:03:26.509742 25195 tablet_loader.cc:96] loaded metadata for tablet e4979050b3154c6292e42c8a3f7c89e7 (table default.table_f0940064a6844fdaadb8859f4257b11f [id=6a7afe82b2724dccb508eb95158c7ec7])
I20261120 09:03:26.510186 25195 tablet_loader.cc:96] loaded metadata for tablet e7f41973f62a48cf8b20ec4d965bfa6e (table default.table_d68821f474e040e18b4d91fbbd850863 [id=9d133f08f71d42b89628f2869cbaa424])
I20261120 09:03:26.514159 25191 sys_catalog.cc:455] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a99947e985094a3e8999fe2aa4e23f18. Latest consensus state: current_term: 4 leader_uuid: "a99947e985094a3e8999fe2aa4e23f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:26.514443 25191 sys_catalog.cc:458] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:26.513948 25194 sys_catalog.cc:455] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "a99947e985094a3e8999fe2aa4e23f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:26.515797 25194 sys_catalog.cc:458] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:26.519419 25195 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261120 09:03:26.522022 25195 catalog_manager.cc:1310] Loaded cluster ID: b96ccaeeefb845f4962e35569b62531b
I20261120 09:03:26.522135 25195 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261120 09:03:26.524806 25195 catalog_manager.cc:1555] Loading token signing keys...
I20261120 09:03:26.526561 25195 catalog_manager.cc:6248] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: Loaded TSK: 0
I20261120 09:03:26.527851 25195 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261120 09:03:26.529572 25195 catalog_manager.cc:1578] Loading latest processed Hive Metastore notification log event ID...
I20261120 09:03:26.531431 25195 catalog_manager.cc:6086] Last processed Hive Metastore notification event ID: 11
I20261120 09:03:26.587581 24312 catalog_manager.cc:2775] deleted HMS catalog entry for table default.table_c97aaa8fd7f446ed8008a6bcecc8b494 [id=f94e62db1de54fcf92c9c893f1a073cf]
W20261120 09:03:26.595686 24377 catalog_manager.cc:3996] Illegal state: an error occurred while updating the sys-catalog: replica d82bf27d60fa450e8f941d1a9d36a825 is not leader of this config: current role FOLLOWER
W20261120 09:03:26.595959 24377 hms_notification_log_listener.cc:330] Failed to handle Hive Metastore notification: 12 ALTER_TABLE default.table_f9f890b63b384c3b9f30da0ba8a80c03: Illegal state: an error occurred while updating the sys-catalog: replica d82bf27d60fa450e8f941d1a9d36a825 is not leader of this config: current role FOLLOWER
W20261120 09:03:26.596094 24377 hms_notification_log_listener.cc:143] Hive Metastore notification log listener poll failed: Service unavailable: lost leadership while handling Hive Metastore notification log events: an error occurred while updating the sys-catalog: replica d82bf27d60fa450e8f941d1a9d36a825 is not leader of this config: current role FOLLOWER
I20261120 09:03:26.596308 24318 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:41728 (request call id 19) took 3237 ms. Trace:
I20261120 09:03:26.596390 24318 rpcz_store.cc:276] 1120 09:03:23.358913 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:23.440433 (+ 81520us) service_pool.cc:224] Handling call
1120 09:03:24.700768 (+1260335us) catalog_manager.cc:2437] Looking up, locking, and authorizing table
1120 09:03:26.596257 (+1895489us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":7923,"Hive Metastore.run_cpu_time_us":884,"Hive Metastore.run_wall_time_us":196543,"spinlock_wait_cycles":3456}
I20261120 09:03:26.599431 24318 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:41728 (request call id 36) took 2667 ms. Trace:
W20261120 09:03:26.599949 24861 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.23.79.124:33881)
I20261120 09:03:26.604575 24318 rpcz_store.cc:276] 1120 09:03:23.932022 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:26.599114 (+2667092us) service_pool.cc:224] Handling call
1120 09:03:26.599380 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20261120 09:03:26.600661 24321 catalog_manager.cc:7244] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_ebc744ebb12d4dd498ca3721c3b9ac6a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20261120 09:03:26.601101 24320 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:41728 (request call id 12) took 3376 ms. Trace:
I20261120 09:03:26.605767 24320 rpcz_store.cc:276] 1120 09:03:23.224666 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:23.224729 (+    63us) service_pool.cc:224] Handling call
1120 09:03:24.700806 (+1476077us) catalog_manager.cc:2437] Looking up, locking, and authorizing table
1120 09:03:26.600556 (+1899750us) catalog_manager.cc:2437] Looking up, locking, and authorizing table
1120 09:03:26.600785 (+   229us) catalog_manager.cc:3769] Apply alter schema
1120 09:03:26.601057 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":427241,"Hive Metastore.run_cpu_time_us":819,"Hive Metastore.run_wall_time_us":79438,"mutex_wait_us":477}
W20261120 09:03:26.606007 24861 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.23.79.124:33881)
I20261120 09:03:26.601670 24312 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:41728 (request call id 30) took 2931 ms. Trace:
I20261120 09:03:26.607306 24318 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:41728 (request call id 38) took 2594 ms. Trace:
W20261120 09:03:26.602746 24315 catalog_manager.cc:7244] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_f2fb9ef502034f008e49c58af534c051 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20261120 09:03:26.607364 24312 rpcz_store.cc:276] 1120 09:03:23.669797 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:24.210078 (+540281us) service_pool.cc:224] Handling call
1120 09:03:24.948206 (+738128us) catalog_manager.cc:2437] Looking up, locking, and authorizing table
1120 09:03:26.601594 (+1653388us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":794424,"Hive Metastore.run_cpu_time_us":346,"Hive Metastore.run_wall_time_us":844563}
I20261120 09:03:26.608080 24312 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:41728 (request call id 39) took 2522 ms. Trace:
I20261120 09:03:26.600414 24319 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:41728 (request call id 13) took 3322 ms. Trace:
I20261120 09:03:26.607463 24318 rpcz_store.cc:276] 1120 09:03:24.012823 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:26.607013 (+2594190us) service_pool.cc:224] Handling call
1120 09:03:26.607239 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20261120 09:03:26.608203 24312 rpcz_store.cc:276] 1120 09:03:24.085700 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:26.607668 (+2521968us) service_pool.cc:224] Handling call
1120 09:03:26.607994 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20261120 09:03:26.608335 24319 rpcz_store.cc:276] 1120 09:03:23.277951 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:23.278012 (+    61us) service_pool.cc:224] Handling call
1120 09:03:24.701059 (+1423047us) catalog_manager.cc:2437] Looking up, locking, and authorizing table
1120 09:03:26.599801 (+1898742us) catalog_manager.cc:2437] Looking up, locking, and authorizing table
1120 09:03:26.600077 (+   276us) catalog_manager.cc:3769] Apply alter schema
1120 09:03:26.600368 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":204325,"Hive Metastore.run_cpu_time_us":853,"Hive Metastore.run_wall_time_us":222674}
I20261120 09:03:26.608584 24318 master_service.cc:965] ReplaceTablet: received request to replace tablet bb6d14de3cb9421987fb9eeb16fbd199 from {username='slave'} at 127.0.0.1:41728
I20261120 09:03:26.608759 24319 master_service.cc:965] ReplaceTablet: received request to replace tablet be76b618f4f142849d785428cd83c0f5 from {username='slave'} at 127.0.0.1:41728
I20261120 09:03:26.609050 24318 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:41728 (request call id 41) took 2253 ms. Trace:
I20261120 09:03:26.609125 24319 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:41728 (request call id 42) took 2242 ms. Trace:
I20261120 09:03:26.609228 24319 rpcz_store.cc:276] 1120 09:03:24.366914 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:26.608631 (+2241717us) service_pool.cc:224] Handling call
1120 09:03:26.609063 (+   432us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20261120 09:03:26.602087 24316 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:41728 (request call id 23) took 3092 ms. Trace:
I20261120 09:03:26.609675 24319 master_service.cc:965] ReplaceTablet: received request to replace tablet 060080d353484c3a85560b493214e484 from {username='slave'} at 127.0.0.1:41728
I20261120 09:03:26.609793 24316 rpcz_store.cc:276] 1120 09:03:23.509764 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:23.858994 (+349230us) service_pool.cc:224] Handling call
1120 09:03:24.703684 (+844690us) catalog_manager.cc:2437] Looking up, locking, and authorizing table
1120 09:03:26.601531 (+1897847us) catalog_manager.cc:2437] Looking up, locking, and authorizing table
1120 09:03:26.601769 (+   238us) catalog_manager.cc:3769] Apply alter schema
1120 09:03:26.602029 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":613610,"Hive Metastore.run_cpu_time_us":922,"Hive Metastore.run_wall_time_us":304774}
I20261120 09:03:26.610116 24319 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:41728 (request call id 43) took 2200 ms. Trace:
I20261120 09:03:26.610309 24316 master_service.cc:965] ReplaceTablet: received request to replace tablet 060080d353484c3a85560b493214e484 from {username='slave'} at 127.0.0.1:41728
I20261120 09:03:26.610252 24319 rpcz_store.cc:276] 1120 09:03:24.409530 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:26.609567 (+2200037us) service_pool.cc:224] Handling call
1120 09:03:26.610058 (+   491us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20261120 09:03:26.610625 24319 master_service.cc:965] ReplaceTablet: received request to replace tablet 8732692e59194cdabba0578275da133b from {username='slave'} at 127.0.0.1:41728
I20261120 09:03:26.609220 24318 rpcz_store.cc:276] 1120 09:03:24.355396 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:26.608402 (+2253006us) service_pool.cc:224] Handling call
1120 09:03:26.608991 (+   589us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20261120 09:03:26.610999 24319 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:41728 (request call id 45) took 2196 ms. Trace:
I20261120 09:03:26.611125 24319 rpcz_store.cc:276] 1120 09:03:24.414470 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:26.610536 (+2196066us) service_pool.cc:224] Handling call
1120 09:03:26.610937 (+   401us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20261120 09:03:26.611227 24318 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:41728 (request call id 46) took 1458 ms. Trace:
I20261120 09:03:26.611634 24318 rpcz_store.cc:276] 1120 09:03:25.152575 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:26.610890 (+1458315us) service_pool.cc:224] Handling call
1120 09:03:26.611188 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20261120 09:03:26.608763 24312 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:41728 (request call id 40) took 2395 ms. Trace:
I20261120 09:03:26.611928 24312 rpcz_store.cc:276] 1120 09:03:24.213200 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:26.608414 (+2395214us) service_pool.cc:224] Handling call
1120 09:03:26.608674 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20261120 09:03:26.612224 24318 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:41728 (request call id 48) took 1074 ms. Trace:
I20261120 09:03:26.612351 24318 rpcz_store.cc:276] 1120 09:03:25.537510 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:26.611864 (+1074354us) service_pool.cc:224] Handling call
1120 09:03:26.612181 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20261120 09:03:26.611635 24319 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:41728 (request call id 47) took 1090 ms. Trace:
I20261120 09:03:26.612836 24319 rpcz_store.cc:276] 1120 09:03:25.521242 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:26.611302 (+1090060us) service_pool.cc:224] Handling call
1120 09:03:26.611565 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20261120 09:03:26.615789 24924 master_runner.cc:233] Existing masters have differing terms: 3 vs 4
I20261120 09:03:26.616051 24924 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:03:26.610741 24316 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:41728 (request call id 44) took 2198 ms. Trace:
I20261120 09:03:26.616138 24316 rpcz_store.cc:276] 1120 09:03:24.412109 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:26.610205 (+2198096us) service_pool.cc:224] Handling call
1120 09:03:26.610684 (+   479us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20261120 09:03:26.617304 24861 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.23.79.124:33881)
W20261120 09:03:26.617776 24861 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.23.79.124:33881)
I20261120 09:03:26.607285 24320 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:41728 (request call id 37) took 2594 ms. Trace:
I20261120 09:03:26.618639 24320 rpcz_store.cc:276] 1120 09:03:24.012426 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:26.607006 (+2594580us) service_pool.cc:224] Handling call
1120 09:03:26.607237 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6528}
I20261120 09:03:26.624594 25078 master_service.cc:965] ReplaceTablet: received request to replace tablet be76b618f4f142849d785428cd83c0f5 from {username='slave'} at 127.0.0.1:59800
I20261120 09:03:26.627380 25072 master_service.cc:965] ReplaceTablet: received request to replace tablet 8732692e59194cdabba0578275da133b from {username='slave'} at 127.0.0.1:59800
I20261120 09:03:26.628126 25076 master_service.cc:965] ReplaceTablet: received request to replace tablet bb6d14de3cb9421987fb9eeb16fbd199 from {username='slave'} at 127.0.0.1:59800
I20261120 09:03:26.629130 25077 master_service.cc:965] ReplaceTablet: received request to replace tablet 060080d353484c3a85560b493214e484 from {username='slave'} at 127.0.0.1:59800
I20261120 09:03:26.626359 25082 catalog_manager.cc:3588] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59800:
table { table_name: "default.Table_3fae2942cff544c29c926cc5ed10a06c" } new_table_name: "default.Table_f9f890b63b384c3b9f30da0ba8a80c03" modify_external_catalogs: true
I20261120 09:03:26.628948 25076 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59800:
name: "default.Table_c622167e221c4db9953d7a278bd41411"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:26.630021 25079 catalog_manager.cc:2551] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59800:
table { table_name: "default.Table_b2351eb1045a47feb0ca7b7422706581" } modify_external_catalogs: true
I20261120 09:03:26.627203 25071 catalog_manager.cc:3588] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59800:
table { table_name: "default.Table_39131cc9c462405ba3639c841ebfe256" } new_table_name: "default.Table_a63a3233f7d94bf99010f9b0c7cb365e" modify_external_catalogs: true
I20261120 09:03:26.625630 25080 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59800:
name: "default.Table_414553f5c3994f4097d7fdbf9dc01082"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:26.630273 25081 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59800:
name: "default.Table_1a335d2b826a4f21a34ac38ad85ff200"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:26.626921 25070 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59800:
name: "default.Table_5b01ae1724c5451c8ac9c936c5c8c983"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:26.632921 25079 catalog_manager.cc:2799] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59800:
table { table_name: "default.Table_b2351eb1045a47feb0ca7b7422706581" } modify_external_catalogs: true
I20261120 09:03:26.640182 25188 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "a99947e985094a3e8999fe2aa4e23f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:26.640401 25188 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: This master's current role is: LEADER
I20261120 09:03:26.663692 25077 catalog_manager.cc:6151] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: Sending DeleteTablet for 3 replicas of tablet 060080d353484c3a85560b493214e484
I20261120 09:03:26.667939 25077 catalog_manager.cc:6952] ReplaceTablet: tablet 060080d353484c3a85560b493214e484 deleted and replaced by tablet 18019fa55aae42be8fb9e5421dd45630
I20261120 09:03:26.676153 25077 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59800:
name: "default.Table_6a2be3a544144a99b0f343bca3024912"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:26.679412 25072 catalog_manager.cc:6151] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: Sending DeleteTablet for 3 replicas of tablet 8732692e59194cdabba0578275da133b
I20261120 09:03:26.679913 25072 catalog_manager.cc:6952] ReplaceTablet: tablet 8732692e59194cdabba0578275da133b deleted and replaced by tablet 26f97270103e4956b82be66244c71301
I20261120 09:03:26.682137 25072 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59800:
name: "default.Table_5f2e35d59fff4bc89139835f148d0414"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:26.685420 25078 catalog_manager.cc:6151] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: Sending DeleteTablet for 3 replicas of tablet be76b618f4f142849d785428cd83c0f5
I20261120 09:03:26.685935 25078 catalog_manager.cc:6952] ReplaceTablet: tablet be76b618f4f142849d785428cd83c0f5 deleted and replaced by tablet e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:03:26.690586 24317 catalog_manager.cc:2775] deleted HMS catalog entry for table default.table_b9d5ad28fd144956bd0715d85a6db556 [id=33f431752a024c38910eb2e3d135295a]
I20261120 09:03:26.690868 25078 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59800:
name: "default.Table_4a315c29012549dcab8e1d9373f99f30"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:26.692247 24317 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:41728 (request call id 33) took 2880 ms. Trace:
I20261120 09:03:26.692358 24317 rpcz_store.cc:276] 1120 09:03:23.811659 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:25.411630 (+1599971us) service_pool.cc:224] Handling call
1120 09:03:26.601257 (+1189627us) catalog_manager.cc:2437] Looking up, locking, and authorizing table
1120 09:03:26.692212 (+ 90955us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":2962,"Hive Metastore.run_cpu_time_us":201,"Hive Metastore.run_wall_time_us":85983}
I20261120 09:03:26.693733 24489 tablet_service.cc:1542] Processing DeleteTablet for tablet 8732692e59194cdabba0578275da133b with delete_type TABLET_DATA_DELETED (replaced by tablet 26f97270103e4956b82be66244c71301) from {username='slave'} at 127.0.0.1:50052
I20261120 09:03:26.694031 24487 tablet_service.cc:1542] Processing DeleteTablet for tablet be76b618f4f142849d785428cd83c0f5 with delete_type TABLET_DATA_DELETED (replaced by tablet e0311b21048c4965ad8ca3cb54bb728d) from {username='slave'} at 127.0.0.1:50052
I20261120 09:03:26.694128 24490 tablet_service.cc:1542] Processing DeleteTablet for tablet 060080d353484c3a85560b493214e484 with delete_type TABLET_DATA_DELETED (replaced by tablet 18019fa55aae42be8fb9e5421dd45630) from {username='slave'} at 127.0.0.1:50052
I20261120 09:03:26.694650 25215 tablet_replica.cc:333] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3: stopping tablet replica
I20261120 09:03:26.694926 25215 raft_consensus.cc:2440] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3 [term 1 LEADER]: Raft consensus shutting down.
I20261120 09:03:26.695232 24486 tablet_service.cc:1495] Processing CreateTablet for tablet 18019fa55aae42be8fb9e5421dd45630 (DEFAULT_TABLE table=default.table_d5638af53ccf40f2b367cf74de29e633 [id=83bafe99e25046a4a43a3739a3ca07a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:26.696614 24486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18019fa55aae42be8fb9e5421dd45630. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:26.707651 24489 tablet_service.cc:1495] Processing CreateTablet for tablet 26f97270103e4956b82be66244c71301 (DEFAULT_TABLE table=default.table_39131cc9c462405ba3639c841ebfe256 [id=cb55967ea90e43be8da1354763f7984c]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:26.708086 24489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26f97270103e4956b82be66244c71301. 1 dirs total, 0 dirs full, 0 dirs failed
W20261120 09:03:26.708985 25160 catalog_manager.cc:6124] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 18019fa55aae42be8fb9e5421dd45630 consensus state has no leader
I20261120 09:03:26.709081 25215 raft_consensus.cc:2469] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261120 09:03:26.709693 25215 ts_tablet_manager.cc:1962] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261120 09:03:26.718135 24489 tablet_service.cc:1495] Processing CreateTablet for tablet e0311b21048c4965ad8ca3cb54bb728d (DEFAULT_TABLE table=default.table_b9d5ad28fd144956bd0715d85a6db556 [id=33f431752a024c38910eb2e3d135295a]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:26.723021 25217 tablet_bootstrap.cc:492] T 18019fa55aae42be8fb9e5421dd45630 P 2c3fe57b9d2c424da181281af303f3c3: Bootstrap starting.
I20261120 09:03:26.725382 25217 tablet_bootstrap.cc:654] T 18019fa55aae42be8fb9e5421dd45630 P 2c3fe57b9d2c424da181281af303f3c3: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:26.728679 25160 catalog_manager.cc:2816] Deleting table default.table_c97aaa8fd7f446ed8008a6bcecc8b494 [id=f94e62db1de54fcf92c9c893f1a073cf] in response to Hive Metastore notification log event 20
I20261120 09:03:26.732079 24641 tablet_service.cc:1542] Processing DeleteTablet for tablet 060080d353484c3a85560b493214e484 with delete_type TABLET_DATA_DELETED (replaced by tablet 18019fa55aae42be8fb9e5421dd45630) from {username='slave'} at 127.0.0.1:40178
I20261120 09:03:26.732427 24639 tablet_service.cc:1542] Processing DeleteTablet for tablet 8732692e59194cdabba0578275da133b with delete_type TABLET_DATA_DELETED (replaced by tablet 26f97270103e4956b82be66244c71301) from {username='slave'} at 127.0.0.1:40178
I20261120 09:03:26.732607 24640 tablet_service.cc:1542] Processing DeleteTablet for tablet be76b618f4f142849d785428cd83c0f5 with delete_type TABLET_DATA_DELETED (replaced by tablet e0311b21048c4965ad8ca3cb54bb728d) from {username='slave'} at 127.0.0.1:40178
I20261120 09:03:26.733004 24642 tablet_service.cc:1495] Processing CreateTablet for tablet 18019fa55aae42be8fb9e5421dd45630 (DEFAULT_TABLE table=default.table_d5638af53ccf40f2b367cf74de29e633 [id=83bafe99e25046a4a43a3739a3ca07a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:26.733425 24642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18019fa55aae42be8fb9e5421dd45630. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:26.734117 24789 tablet_service.cc:1542] Processing DeleteTablet for tablet 8732692e59194cdabba0578275da133b with delete_type TABLET_DATA_DELETED (replaced by tablet 26f97270103e4956b82be66244c71301) from {username='slave'} at 127.0.0.1:43964
I20261120 09:03:26.734542 24788 tablet_service.cc:1542] Processing DeleteTablet for tablet 060080d353484c3a85560b493214e484 with delete_type TABLET_DATA_DELETED (replaced by tablet 18019fa55aae42be8fb9e5421dd45630) from {username='slave'} at 127.0.0.1:43964
I20261120 09:03:26.734809 24787 tablet_service.cc:1542] Processing DeleteTablet for tablet be76b618f4f142849d785428cd83c0f5 with delete_type TABLET_DATA_DELETED (replaced by tablet e0311b21048c4965ad8ca3cb54bb728d) from {username='slave'} at 127.0.0.1:43964
I20261120 09:03:26.735288 24785 tablet_service.cc:1495] Processing CreateTablet for tablet 26f97270103e4956b82be66244c71301 (DEFAULT_TABLE table=default.table_39131cc9c462405ba3639c841ebfe256 [id=cb55967ea90e43be8da1354763f7984c]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:26.735720 24785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26f97270103e4956b82be66244c71301. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:26.738822 24784 tablet_service.cc:1495] Processing CreateTablet for tablet e0311b21048c4965ad8ca3cb54bb728d (DEFAULT_TABLE table=default.table_b9d5ad28fd144956bd0715d85a6db556 [id=33f431752a024c38910eb2e3d135295a]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:26.739387 24784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0311b21048c4965ad8ca3cb54bb728d. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:26.740336 24786 tablet_service.cc:1495] Processing CreateTablet for tablet 18019fa55aae42be8fb9e5421dd45630 (DEFAULT_TABLE table=default.table_d5638af53ccf40f2b367cf74de29e633 [id=83bafe99e25046a4a43a3739a3ca07a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:26.740792 24786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18019fa55aae42be8fb9e5421dd45630. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:26.741688 24638 tablet_service.cc:1495] Processing CreateTablet for tablet 26f97270103e4956b82be66244c71301 (DEFAULT_TABLE table=default.table_39131cc9c462405ba3639c841ebfe256 [id=cb55967ea90e43be8da1354763f7984c]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:26.742192 24638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26f97270103e4956b82be66244c71301. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:26.743932 25160 catalog_manager.cc:6151] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: Sending DeleteTablet for 3 replicas of tablet a8cf83af75c745dc96cb98f99cd2335d
I20261120 09:03:26.745126 25082 master_service.cc:965] ReplaceTablet: received request to replace tablet 060080d353484c3a85560b493214e484 from {username='slave'} at 127.0.0.1:59800
I20261120 09:03:26.745867 25082 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59800:
name: "default.Table_a01c7b2bf886427c8666dcf79bf881e8"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:26.750995 25221 tablet_replica.cc:333] T 8732692e59194cdabba0578275da133b P 8668dad23e404dafb0ac25267f07bd46: stopping tablet replica
I20261120 09:03:26.751286 25221 raft_consensus.cc:2440] T 8732692e59194cdabba0578275da133b P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Raft consensus shutting down.
W20261120 09:03:26.746467 25056 catalog_manager.cc:4863] Async tablet task AlterTable RPC for tablet 18019fa55aae42be8fb9e5421dd45630 (table default.table_0d4b09a9b1754e38bca62e97c14a0854 [id=83bafe99e25046a4a43a3739a3ca07a1], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 18019fa55aae42be8fb9e5421dd45630 consensus state has no leader
I20261120 09:03:26.738237 24637 tablet_service.cc:1495] Processing CreateTablet for tablet e0311b21048c4965ad8ca3cb54bb728d (DEFAULT_TABLE table=default.table_b9d5ad28fd144956bd0715d85a6db556 [id=33f431752a024c38910eb2e3d135295a]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:26.751897 25221 raft_consensus.cc:2469] T 8732692e59194cdabba0578275da133b P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261120 09:03:26.752046 24637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0311b21048c4965ad8ca3cb54bb728d. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:26.752660 25221 ts_tablet_manager.cc:1962] T 8732692e59194cdabba0578275da133b P 8668dad23e404dafb0ac25267f07bd46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261120 09:03:26.751453 25160 catalog_manager.cc:2816] Deleting table default.table_b9d5ad28fd144956bd0715d85a6db556 [id=33f431752a024c38910eb2e3d135295a] in response to Hive Metastore notification log event 21
I20261120 09:03:26.756366 24640 tablet_service.cc:1542] Processing DeleteTablet for tablet a8cf83af75c745dc96cb98f99cd2335d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-11-20 09:03:26 UTC) from {username='slave'} at 127.0.0.1:40178
I20261120 09:03:26.767237 25221 ts_tablet_manager.cc:1975] T 8732692e59194cdabba0578275da133b P 8668dad23e404dafb0ac25267f07bd46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20261120 09:03:26.769371 25160 catalog_manager.cc:6151] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: Sending DeleteTablet for 3 replicas of tablet e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:03:26.770442 25221 log.cc:1199] T 8732692e59194cdabba0578275da133b P 8668dad23e404dafb0ac25267f07bd46: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-2/wal/wals/8732692e59194cdabba0578275da133b
I20261120 09:03:26.771023 25221 ts_tablet_manager.cc:1996] T 8732692e59194cdabba0578275da133b P 8668dad23e404dafb0ac25267f07bd46: Deleting consensus metadata
W20261120 09:03:26.771401 25076 catalog_manager.cc:7244] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_c622167e221c4db9953d7a278bd41411 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20261120 09:03:26.769176 25224 tablet_bootstrap.cc:492] T 18019fa55aae42be8fb9e5421dd45630 P 8668dad23e404dafb0ac25267f07bd46: Bootstrap starting.
I20261120 09:03:26.773572 25224 tablet_bootstrap.cc:654] T 18019fa55aae42be8fb9e5421dd45630 P 8668dad23e404dafb0ac25267f07bd46: Neither blocks nor log segments found. Creating new log.
W20261120 09:03:26.773725 25080 catalog_manager.cc:7244] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_414553f5c3994f4097d7fdbf9dc01082 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20261120 09:03:26.774956 25081 catalog_manager.cc:7244] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_1a335d2b826a4f21a34ac38ad85ff200 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20261120 09:03:26.775267 25221 tablet_replica.cc:333] T 060080d353484c3a85560b493214e484 P 8668dad23e404dafb0ac25267f07bd46: stopping tablet replica
I20261120 09:03:26.775549 25221 raft_consensus.cc:2440] T 060080d353484c3a85560b493214e484 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20261120 09:03:26.776042 25221 raft_consensus.cc:2469] T 060080d353484c3a85560b493214e484 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Raft consensus is shut down!
W20261120 09:03:26.776250 25070 catalog_manager.cc:7244] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_5b01ae1724c5451c8ac9c936c5c8c983 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20261120 09:03:26.777310 25221 ts_tablet_manager.cc:1962] T 060080d353484c3a85560b493214e484 P 8668dad23e404dafb0ac25267f07bd46: Deleting tablet data with delete state TABLET_DATA_DELETED
W20261120 09:03:26.777894 25077 catalog_manager.cc:7244] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_6a2be3a544144a99b0f343bca3024912 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20261120 09:03:26.779162 25072 catalog_manager.cc:7244] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_5f2e35d59fff4bc89139835f148d0414 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20261120 09:03:26.780189 25078 catalog_manager.cc:7244] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_4a315c29012549dcab8e1d9373f99f30 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20261120 09:03:26.782232 24640 tablet_service.cc:1542] Processing DeleteTablet for tablet e0311b21048c4965ad8ca3cb54bb728d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-11-20 09:03:26 UTC) from {username='slave'} at 127.0.0.1:40178
I20261120 09:03:26.789261 25224 tablet_bootstrap.cc:492] T 18019fa55aae42be8fb9e5421dd45630 P 8668dad23e404dafb0ac25267f07bd46: No bootstrap required, opened a new log
I20261120 09:03:26.789491 25224 ts_tablet_manager.cc:1449] T 18019fa55aae42be8fb9e5421dd45630 P 8668dad23e404dafb0ac25267f07bd46: Time spent bootstrapping tablet: real 0.020s	user 0.003s	sys 0.004s
I20261120 09:03:26.790474 25224 raft_consensus.cc:366] T 18019fa55aae42be8fb9e5421dd45630 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:26.790836 25224 raft_consensus.cc:392] T 18019fa55aae42be8fb9e5421dd45630 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:26.790982 25224 raft_consensus.cc:787] T 18019fa55aae42be8fb9e5421dd45630 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Initialized, Role: FOLLOWER
I20261120 09:03:26.791265 25224 consensus_queue.cc:261] T 18019fa55aae42be8fb9e5421dd45630 P 8668dad23e404dafb0ac25267f07bd46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:26.792065 24855 heartbeater.cc:500] Master 127.23.79.126:41659 was elected leader, sending a full tablet report...
I20261120 09:03:26.795503 25221 ts_tablet_manager.cc:1975] T 060080d353484c3a85560b493214e484 P 8668dad23e404dafb0ac25267f07bd46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20261120 09:03:26.795630 25221 log.cc:1199] T 060080d353484c3a85560b493214e484 P 8668dad23e404dafb0ac25267f07bd46: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-2/wal/wals/060080d353484c3a85560b493214e484
I20261120 09:03:26.795997 25221 ts_tablet_manager.cc:1996] T 060080d353484c3a85560b493214e484 P 8668dad23e404dafb0ac25267f07bd46: Deleting consensus metadata
I20261120 09:03:26.796870 25221 tablet_replica.cc:333] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46: stopping tablet replica
I20261120 09:03:26.797039 25221 raft_consensus.cc:2440] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46 [term 1 LEADER]: Raft consensus shutting down.
I20261120 09:03:26.797587 25221 raft_consensus.cc:2469] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261120 09:03:26.802281 25221 ts_tablet_manager.cc:1962] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261120 09:03:26.807236 25215 ts_tablet_manager.cc:1975] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20261120 09:03:26.807444 25215 log.cc:1199] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-0/wal/wals/8732692e59194cdabba0578275da133b
I20261120 09:03:26.807991 25215 ts_tablet_manager.cc:1996] T 8732692e59194cdabba0578275da133b P 2c3fe57b9d2c424da181281af303f3c3: Deleting consensus metadata
I20261120 09:03:26.809473 25215 tablet_replica.cc:333] T be76b618f4f142849d785428cd83c0f5 P 2c3fe57b9d2c424da181281af303f3c3: stopping tablet replica
I20261120 09:03:26.809831 25215 raft_consensus.cc:2440] T be76b618f4f142849d785428cd83c0f5 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20261120 09:03:26.810096 25215 raft_consensus.cc:2469] T be76b618f4f142849d785428cd83c0f5 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261120 09:03:26.810858 25215 ts_tablet_manager.cc:1962] T be76b618f4f142849d785428cd83c0f5 P 2c3fe57b9d2c424da181281af303f3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261120 09:03:26.814294 24489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0311b21048c4965ad8ca3cb54bb728d. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:26.814416 24488 tablet_service.cc:1542] Processing DeleteTablet for tablet a8cf83af75c745dc96cb98f99cd2335d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-11-20 09:03:26 UTC) from {username='slave'} at 127.0.0.1:50052
I20261120 09:03:26.816648 24783 tablet_service.cc:1542] Processing DeleteTablet for tablet a8cf83af75c745dc96cb98f99cd2335d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-11-20 09:03:26 UTC) from {username='slave'} at 127.0.0.1:43964
I20261120 09:03:26.817991 24784 tablet_service.cc:1542] Processing DeleteTablet for tablet e0311b21048c4965ad8ca3cb54bb728d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-11-20 09:03:26 UTC) from {username='slave'} at 127.0.0.1:43964
I20261120 09:03:26.822466 25055 catalog_manager.cc:5081] TS 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): tablet 8732692e59194cdabba0578275da133b (table default.table_39131cc9c462405ba3639c841ebfe256 [id=cb55967ea90e43be8da1354763f7984c]) successfully deleted
I20261120 09:03:26.822902 24488 tablet_service.cc:1542] Processing DeleteTablet for tablet e0311b21048c4965ad8ca3cb54bb728d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-11-20 09:03:26 UTC) from {username='slave'} at 127.0.0.1:50052
I20261120 09:03:26.823414 25239 tablet.cc:1872] T 75e156478a8a470ba5f4942cd8e6a89e P 2c3fe57b9d2c424da181281af303f3c3: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20261120 09:03:26.825709 25234 tablet_bootstrap.cc:492] T 26f97270103e4956b82be66244c71301 P 2fb9ff0dc3d849d7bcf95806233d2c62: Bootstrap starting.
I20261120 09:03:26.826948 25055 catalog_manager.cc:5081] TS 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): tablet 8732692e59194cdabba0578275da133b (table default.table_39131cc9c462405ba3639c841ebfe256 [id=cb55967ea90e43be8da1354763f7984c]) successfully deleted
I20261120 09:03:26.827069 25221 ts_tablet_manager.cc:1975] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20261120 09:03:26.827199 25221 log.cc:1199] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-2/wal/wals/be76b618f4f142849d785428cd83c0f5
I20261120 09:03:26.827620 25221 ts_tablet_manager.cc:1996] T be76b618f4f142849d785428cd83c0f5 P 8668dad23e404dafb0ac25267f07bd46: Deleting consensus metadata
I20261120 09:03:26.828423 25055 catalog_manager.cc:5081] TS 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): tablet 060080d353484c3a85560b493214e484 (table default.table_0d4b09a9b1754e38bca62e97c14a0854 [id=83bafe99e25046a4a43a3739a3ca07a1]) successfully deleted
I20261120 09:03:26.828691 25221 tablet_replica.cc:333] T a8cf83af75c745dc96cb98f99cd2335d P 8668dad23e404dafb0ac25267f07bd46: stopping tablet replica
I20261120 09:03:26.828955 25221 raft_consensus.cc:2440] T a8cf83af75c745dc96cb98f99cd2335d P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20261120 09:03:26.835614 25215 ts_tablet_manager.cc:1975] T be76b618f4f142849d785428cd83c0f5 P 2c3fe57b9d2c424da181281af303f3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20261120 09:03:26.836421 25215 log.cc:1199] T be76b618f4f142849d785428cd83c0f5 P 2c3fe57b9d2c424da181281af303f3c3: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-0/wal/wals/be76b618f4f142849d785428cd83c0f5
I20261120 09:03:26.837024 25215 ts_tablet_manager.cc:1996] T be76b618f4f142849d785428cd83c0f5 P 2c3fe57b9d2c424da181281af303f3c3: Deleting consensus metadata
I20261120 09:03:26.850440 25221 raft_consensus.cc:2469] T a8cf83af75c745dc96cb98f99cd2335d P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261120 09:03:26.851596 25221 ts_tablet_manager.cc:1962] T a8cf83af75c745dc96cb98f99cd2335d P 8668dad23e404dafb0ac25267f07bd46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261120 09:03:26.858532 25215 tablet_replica.cc:333] T 060080d353484c3a85560b493214e484 P 2c3fe57b9d2c424da181281af303f3c3: stopping tablet replica
I20261120 09:03:26.859464 25215 raft_consensus.cc:2440] T 060080d353484c3a85560b493214e484 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20261120 09:03:26.861312 25220 tablet_replica.cc:333] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62: stopping tablet replica
I20261120 09:03:26.861601 25220 raft_consensus.cc:2440] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 LEADER]: Raft consensus shutting down.
I20261120 09:03:26.862289 25220 raft_consensus.cc:2469] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261120 09:03:26.861223 24568 heartbeater.cc:500] Master 127.23.79.126:41659 was elected leader, sending a full tablet report...
I20261120 09:03:26.863732 25215 raft_consensus.cc:2469] T 060080d353484c3a85560b493214e484 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261120 09:03:26.865275 25215 ts_tablet_manager.cc:1962] T 060080d353484c3a85560b493214e484 P 2c3fe57b9d2c424da181281af303f3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261120 09:03:26.869225 25220 ts_tablet_manager.cc:1962] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261120 09:03:26.870662 25239 tablet.cc:1872] T a27e6c05e40742d4ab0116c2e22cd4ba P 2c3fe57b9d2c424da181281af303f3c3: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20261120 09:03:26.883421 25221 ts_tablet_manager.cc:1975] T a8cf83af75c745dc96cb98f99cd2335d P 8668dad23e404dafb0ac25267f07bd46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20261120 09:03:26.883585 25221 log.cc:1199] T a8cf83af75c745dc96cb98f99cd2335d P 8668dad23e404dafb0ac25267f07bd46: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-2/wal/wals/a8cf83af75c745dc96cb98f99cd2335d
I20261120 09:03:26.883978 25221 ts_tablet_manager.cc:1996] T a8cf83af75c745dc96cb98f99cd2335d P 8668dad23e404dafb0ac25267f07bd46: Deleting consensus metadata
I20261120 09:03:26.885109 25055 catalog_manager.cc:5081] TS 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): tablet a8cf83af75c745dc96cb98f99cd2335d (table default.table_c97aaa8fd7f446ed8008a6bcecc8b494 [id=f94e62db1de54fcf92c9c893f1a073cf]) successfully deleted
I20261120 09:03:26.885452 25224 ts_tablet_manager.cc:1480] T 18019fa55aae42be8fb9e5421dd45630 P 8668dad23e404dafb0ac25267f07bd46: Time spent starting tablet: real 0.096s	user 0.007s	sys 0.017s
I20261120 09:03:26.888486 25234 tablet_bootstrap.cc:654] T 26f97270103e4956b82be66244c71301 P 2fb9ff0dc3d849d7bcf95806233d2c62: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:26.889897 25224 tablet_bootstrap.cc:492] T 26f97270103e4956b82be66244c71301 P 8668dad23e404dafb0ac25267f07bd46: Bootstrap starting.
I20261120 09:03:26.893071 25224 tablet_bootstrap.cc:654] T 26f97270103e4956b82be66244c71301 P 8668dad23e404dafb0ac25267f07bd46: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:26.900746 25215 ts_tablet_manager.cc:1975] T 060080d353484c3a85560b493214e484 P 2c3fe57b9d2c424da181281af303f3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20261120 09:03:26.901000 25220 ts_tablet_manager.cc:1975] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20261120 09:03:26.901253 25220 log.cc:1199] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-1/wal/wals/060080d353484c3a85560b493214e484
I20261120 09:03:26.901835 25220 ts_tablet_manager.cc:1996] T 060080d353484c3a85560b493214e484 P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting consensus metadata
I20261120 09:03:26.902736 25057 catalog_manager.cc:5081] TS 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): tablet 060080d353484c3a85560b493214e484 (table default.table_0d4b09a9b1754e38bca62e97c14a0854 [id=83bafe99e25046a4a43a3739a3ca07a1]) successfully deleted
I20261120 09:03:26.903082 25247 tablet.cc:1872] T 707757cc32af4fe98d4a04e6a7498c17 P 8668dad23e404dafb0ac25267f07bd46: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20261120 09:03:26.903429 25246 tablet.cc:1872] T a27e6c05e40742d4ab0116c2e22cd4ba P 2fb9ff0dc3d849d7bcf95806233d2c62: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20261120 09:03:26.905561 25220 tablet_replica.cc:333] T 8732692e59194cdabba0578275da133b P 2fb9ff0dc3d849d7bcf95806233d2c62: stopping tablet replica
I20261120 09:03:26.905804 25220 raft_consensus.cc:2440] T 8732692e59194cdabba0578275da133b P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20261120 09:03:26.906072 25220 raft_consensus.cc:2469] T 8732692e59194cdabba0578275da133b P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261120 09:03:26.898774 25244 tablet.cc:1872] T 75e156478a8a470ba5f4942cd8e6a89e P 8668dad23e404dafb0ac25267f07bd46: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20261120 09:03:26.906664 25220 ts_tablet_manager.cc:1962] T 8732692e59194cdabba0578275da133b P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting tablet data with delete state TABLET_DATA_DELETED
W20261120 09:03:26.912569 25055 catalog_manager.cc:5061] TS 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): delete failed for tablet e0311b21048c4965ad8ca3cb54bb728d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e0311b21048c4965ad8ca3cb54bb728d already in progress: creating tablet
I20261120 09:03:26.918715 25247 tablet.cc:1872] T a27e6c05e40742d4ab0116c2e22cd4ba P 8668dad23e404dafb0ac25267f07bd46: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20261120 09:03:26.922812 25076 catalog_manager.cc:2218] created HMS catalog entry for table  [id=b21dc844213f4fc8b0f28c935f221a1b]
I20261120 09:03:26.923699 25220 ts_tablet_manager.cc:1975] T 8732692e59194cdabba0578275da133b P 2fb9ff0dc3d849d7bcf95806233d2c62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20261120 09:03:26.923992 25220 log.cc:1199] T 8732692e59194cdabba0578275da133b P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-1/wal/wals/8732692e59194cdabba0578275da133b
I20261120 09:03:26.924499 25220 ts_tablet_manager.cc:1996] T 8732692e59194cdabba0578275da133b P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting consensus metadata
I20261120 09:03:26.925028 25220 tablet_replica.cc:333] T be76b618f4f142849d785428cd83c0f5 P 2fb9ff0dc3d849d7bcf95806233d2c62: stopping tablet replica
I20261120 09:03:26.925148 25057 catalog_manager.cc:5081] TS 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): tablet 8732692e59194cdabba0578275da133b (table default.table_39131cc9c462405ba3639c841ebfe256 [id=cb55967ea90e43be8da1354763f7984c]) successfully deleted
I20261120 09:03:26.925271 25220 raft_consensus.cc:2440] T be76b618f4f142849d785428cd83c0f5 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20261120 09:03:26.925539 25220 raft_consensus.cc:2469] T be76b618f4f142849d785428cd83c0f5 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261120 09:03:26.926153 25220 ts_tablet_manager.cc:1962] T be76b618f4f142849d785428cd83c0f5 P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261120 09:03:26.900980 25239 tablet.cc:1872] T 707757cc32af4fe98d4a04e6a7498c17 P 2c3fe57b9d2c424da181281af303f3c3: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20261120 09:03:26.904764 25217 tablet_bootstrap.cc:492] T 18019fa55aae42be8fb9e5421dd45630 P 2c3fe57b9d2c424da181281af303f3c3: No bootstrap required, opened a new log
I20261120 09:03:26.928097 25217 ts_tablet_manager.cc:1449] T 18019fa55aae42be8fb9e5421dd45630 P 2c3fe57b9d2c424da181281af303f3c3: Time spent bootstrapping tablet: real 0.205s	user 0.013s	sys 0.039s
I20261120 09:03:26.928310 25215 log.cc:1199] T 060080d353484c3a85560b493214e484 P 2c3fe57b9d2c424da181281af303f3c3: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-0/wal/wals/060080d353484c3a85560b493214e484
I20261120 09:03:26.928833 25215 ts_tablet_manager.cc:1996] T 060080d353484c3a85560b493214e484 P 2c3fe57b9d2c424da181281af303f3c3: Deleting consensus metadata
I20261120 09:03:26.929020 25217 raft_consensus.cc:366] T 18019fa55aae42be8fb9e5421dd45630 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:26.929245 25217 raft_consensus.cc:392] T 18019fa55aae42be8fb9e5421dd45630 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:26.929384 25217 raft_consensus.cc:787] T 18019fa55aae42be8fb9e5421dd45630 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Initialized, Role: FOLLOWER
I20261120 09:03:26.929616 25217 consensus_queue.cc:261] T 18019fa55aae42be8fb9e5421dd45630 P 2c3fe57b9d2c424da181281af303f3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:26.930163 25215 tablet_replica.cc:333] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3: stopping tablet replica
I20261120 09:03:26.930254 25217 ts_tablet_manager.cc:1480] T 18019fa55aae42be8fb9e5421dd45630 P 2c3fe57b9d2c424da181281af303f3c3: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
I20261120 09:03:26.930364 25215 raft_consensus.cc:2440] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3 [term 1 LEADER]: Raft consensus shutting down.
I20261120 09:03:26.919533 25249 tablet.cc:1872] T 75e156478a8a470ba5f4942cd8e6a89e P 2fb9ff0dc3d849d7bcf95806233d2c62: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20261120 09:03:26.932734 25217 tablet_bootstrap.cc:492] T 26f97270103e4956b82be66244c71301 P 2c3fe57b9d2c424da181281af303f3c3: Bootstrap starting.
I20261120 09:03:26.934201 25215 raft_consensus.cc:2469] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261120 09:03:26.934854 25217 tablet_bootstrap.cc:654] T 26f97270103e4956b82be66244c71301 P 2c3fe57b9d2c424da181281af303f3c3: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:26.935047 25055 catalog_manager.cc:5081] TS 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): tablet 060080d353484c3a85560b493214e484 (table default.table_0d4b09a9b1754e38bca62e97c14a0854 [id=83bafe99e25046a4a43a3739a3ca07a1]) successfully deleted
I20261120 09:03:26.935526 25215 ts_tablet_manager.cc:1962] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261120 09:03:26.946269 25215 ts_tablet_manager.cc:1975] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20261120 09:03:26.947921 25215 log.cc:1199] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-0/wal/wals/a8cf83af75c745dc96cb98f99cd2335d
I20261120 09:03:26.948766 25224 tablet_bootstrap.cc:492] T 26f97270103e4956b82be66244c71301 P 8668dad23e404dafb0ac25267f07bd46: No bootstrap required, opened a new log
I20261120 09:03:26.948941 25224 ts_tablet_manager.cc:1449] T 26f97270103e4956b82be66244c71301 P 8668dad23e404dafb0ac25267f07bd46: Time spent bootstrapping tablet: real 0.059s	user 0.003s	sys 0.005s
I20261120 09:03:26.949808 25224 raft_consensus.cc:366] T 26f97270103e4956b82be66244c71301 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:26.950006 25224 raft_consensus.cc:392] T 26f97270103e4956b82be66244c71301 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:26.950071 25224 raft_consensus.cc:787] T 26f97270103e4956b82be66244c71301 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Initialized, Role: FOLLOWER
I20261120 09:03:26.950289 25224 consensus_queue.cc:261] T 26f97270103e4956b82be66244c71301 P 8668dad23e404dafb0ac25267f07bd46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:26.951299 24708 heartbeater.cc:500] Master 127.23.79.126:41659 was elected leader, sending a full tablet report...
I20261120 09:03:26.952750 25224 ts_tablet_manager.cc:1480] T 26f97270103e4956b82be66244c71301 P 8668dad23e404dafb0ac25267f07bd46: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.002s
I20261120 09:03:26.953099 25224 tablet_bootstrap.cc:492] T e0311b21048c4965ad8ca3cb54bb728d P 8668dad23e404dafb0ac25267f07bd46: Bootstrap starting.
I20261120 09:03:26.955794 25224 tablet_bootstrap.cc:654] T e0311b21048c4965ad8ca3cb54bb728d P 8668dad23e404dafb0ac25267f07bd46: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:26.957365 25215 ts_tablet_manager.cc:1996] T a8cf83af75c745dc96cb98f99cd2335d P 2c3fe57b9d2c424da181281af303f3c3: Deleting consensus metadata
I20261120 09:03:26.958166 24641 tablet_service.cc:1495] Processing CreateTablet for tablet 212960af80bf45deb7c508c3356d3391 (DEFAULT_TABLE table=default.table_c622167e221c4db9953d7a278bd41411 [id=b21dc844213f4fc8b0f28c935f221a1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:26.961179 25076 catalog_manager.cc:5956] TS 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035) does not have the latest schema for tablet 75e156478a8a470ba5f4942cd8e6a89e (table default.table_f9f890b63b384c3b9f30da0ba8a80c03 [id=315bdedf9fe44e5d866534884f65f6d4]). Expected version 1 got 0
I20261120 09:03:26.961522 25076 catalog_manager.cc:5856] T e4979050b3154c6292e42c8a3f7c89e7 P 8668dad23e404dafb0ac25267f07bd46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66). New cstate: current_term: 1 leader_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } }
I20261120 09:03:26.962328 25076 catalog_manager.cc:5956] TS 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035) does not have the latest schema for tablet 26f97270103e4956b82be66244c71301 (table default.table_39131cc9c462405ba3639c841ebfe256 [id=cb55967ea90e43be8da1354763f7984c]). Expected version 1 got 0
I20261120 09:03:26.962620 25076 catalog_manager.cc:5956] TS 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035) does not have the latest schema for tablet 18019fa55aae42be8fb9e5421dd45630 (table default.table_0d4b09a9b1754e38bca62e97c14a0854 [id=83bafe99e25046a4a43a3739a3ca07a1]). Expected version 1 got 0
I20261120 09:03:26.962832 25076 catalog_manager.cc:5956] TS 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035) does not have the latest schema for tablet a27e6c05e40742d4ab0116c2e22cd4ba (table default.table_784f78c485a74606a638a81633a149e7 [id=aa6cfb171b4c482caa17d7c0862da3d0]). Expected version 1 got 0
I20261120 09:03:26.963040 25076 catalog_manager.cc:5856] T bf5c1cdd4f5c4ce6b89f099b65629910 P 8668dad23e404dafb0ac25267f07bd46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67). New cstate: current_term: 1 leader_uuid: "8668dad23e404dafb0ac25267f07bd46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } health_report { overall_health: HEALTHY } } }
I20261120 09:03:26.963595 25076 catalog_manager.cc:5956] TS 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035) does not have the latest schema for tablet 707757cc32af4fe98d4a04e6a7498c17 (table default.table_4d5337371cd3454fa5aae228272e5fda [id=90570e46cebe47eba97e5b980f23e909]). Expected version 1 got 0
I20261120 09:03:26.965888 25224 tablet_bootstrap.cc:492] T e0311b21048c4965ad8ca3cb54bb728d P 8668dad23e404dafb0ac25267f07bd46: No bootstrap required, opened a new log
I20261120 09:03:26.966528 25224 ts_tablet_manager.cc:1449] T e0311b21048c4965ad8ca3cb54bb728d P 8668dad23e404dafb0ac25267f07bd46: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.003s
I20261120 09:03:26.966563 25055 catalog_manager.cc:5081] TS 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): tablet a8cf83af75c745dc96cb98f99cd2335d (table default.table_c97aaa8fd7f446ed8008a6bcecc8b494 [id=f94e62db1de54fcf92c9c893f1a073cf]) successfully deleted
W20261120 09:03:26.966815 25055 catalog_manager.cc:5061] TS 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): delete failed for tablet e0311b21048c4965ad8ca3cb54bb728d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e0311b21048c4965ad8ca3cb54bb728d already in progress: creating tablet
I20261120 09:03:26.966912 24784 tablet_service.cc:1495] Processing CreateTablet for tablet 212960af80bf45deb7c508c3356d3391 (DEFAULT_TABLE table=default.table_c622167e221c4db9953d7a278bd41411 [id=b21dc844213f4fc8b0f28c935f221a1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:26.967309 24784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 212960af80bf45deb7c508c3356d3391. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:26.967367 25224 raft_consensus.cc:366] T e0311b21048c4965ad8ca3cb54bb728d P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:26.967571 25224 raft_consensus.cc:392] T e0311b21048c4965ad8ca3cb54bb728d P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:26.967679 25224 raft_consensus.cc:787] T e0311b21048c4965ad8ca3cb54bb728d P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Initialized, Role: FOLLOWER
I20261120 09:03:26.967955 25224 consensus_queue.cc:261] T e0311b21048c4965ad8ca3cb54bb728d P 8668dad23e404dafb0ac25267f07bd46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:26.969482 25224 ts_tablet_manager.cc:1480] T e0311b21048c4965ad8ca3cb54bb728d P 8668dad23e404dafb0ac25267f07bd46: Time spent starting tablet: real 0.003s	user 0.002s	sys 0.000s
I20261120 09:03:26.970911 24486 tablet_service.cc:1495] Processing CreateTablet for tablet 212960af80bf45deb7c508c3356d3391 (DEFAULT_TABLE table=default.table_c622167e221c4db9953d7a278bd41411 [id=b21dc844213f4fc8b0f28c935f221a1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:26.971386 24486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 212960af80bf45deb7c508c3356d3391. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:26.975392 25217 tablet_bootstrap.cc:492] T 26f97270103e4956b82be66244c71301 P 2c3fe57b9d2c424da181281af303f3c3: No bootstrap required, opened a new log
I20261120 09:03:26.975571 25217 ts_tablet_manager.cc:1449] T 26f97270103e4956b82be66244c71301 P 2c3fe57b9d2c424da181281af303f3c3: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.002s
I20261120 09:03:26.976184 24314 catalog_manager.cc:2775] deleted HMS catalog entry for table default.table_d68821f474e040e18b4d91fbbd850863 [id=9d133f08f71d42b89628f2869cbaa424]
I20261120 09:03:26.976411 25217 raft_consensus.cc:366] T 26f97270103e4956b82be66244c71301 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:26.976600 25217 raft_consensus.cc:392] T 26f97270103e4956b82be66244c71301 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:26.976679 25217 raft_consensus.cc:787] T 26f97270103e4956b82be66244c71301 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Initialized, Role: FOLLOWER
I20261120 09:03:26.976702 24314 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:41728 (request call id 32) took 3244 ms. Trace:
I20261120 09:03:26.976920 25217 consensus_queue.cc:261] T 26f97270103e4956b82be66244c71301 P 2c3fe57b9d2c424da181281af303f3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:26.977298 24314 rpcz_store.cc:276] 1120 09:03:23.731784 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:25.339327 (+1607543us) service_pool.cc:224] Handling call
1120 09:03:26.601258 (+1261931us) catalog_manager.cc:2437] Looking up, locking, and authorizing table
1120 09:03:26.976660 (+375402us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":89003,"Hive Metastore.run_cpu_time_us":183,"Hive Metastore.run_wall_time_us":285133,"mutex_wait_us":37}
I20261120 09:03:26.978446 25217 ts_tablet_manager.cc:1480] T 26f97270103e4956b82be66244c71301 P 2c3fe57b9d2c424da181281af303f3c3: Time spent starting tablet: real 0.003s	user 0.001s	sys 0.001s
I20261120 09:03:26.978786 25217 tablet_bootstrap.cc:492] T e0311b21048c4965ad8ca3cb54bb728d P 2c3fe57b9d2c424da181281af303f3c3: Bootstrap starting.
I20261120 09:03:26.991111 25217 tablet_bootstrap.cc:654] T e0311b21048c4965ad8ca3cb54bb728d P 2c3fe57b9d2c424da181281af303f3c3: Neither blocks nor log segments found. Creating new log.
W20261120 09:03:26.992260 25076 catalog_manager.cc:6056] Failed to send AlterTable RPC for tablet 26f97270103e4956b82be66244c71301 (table default.table_39131cc9c462405ba3639c841ebfe256 [id=cb55967ea90e43be8da1354763f7984c], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 26f97270103e4956b82be66244c71301 consensus state has no leader
I20261120 09:03:27.003206 24783 tablet_service.cc:1542] Processing DeleteTablet for tablet a8cf83af75c745dc96cb98f99cd2335d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-11-20 09:03:26 UTC) from {username='slave'} at 127.0.0.1:43964
I20261120 09:03:27.003533 24785 tablet_service.cc:1542] Processing DeleteTablet for tablet 060080d353484c3a85560b493214e484 with delete_type TABLET_DATA_DELETED (replaced by tablet 18019fa55aae42be8fb9e5421dd45630) from {username='slave'} at 127.0.0.1:43964
I20261120 09:03:27.003883 24786 tablet_service.cc:1542] Processing DeleteTablet for tablet be76b618f4f142849d785428cd83c0f5 with delete_type TABLET_DATA_DELETED (replaced by tablet e0311b21048c4965ad8ca3cb54bb728d) from {username='slave'} at 127.0.0.1:43964
I20261120 09:03:27.006321 24786 tablet_service.cc:1542] Processing DeleteTablet for tablet e0311b21048c4965ad8ca3cb54bb728d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-11-20 09:03:26 UTC) from {username='slave'} at 127.0.0.1:43964
I20261120 09:03:27.006582 25221 tablet_replica.cc:333] T e0311b21048c4965ad8ca3cb54bb728d P 8668dad23e404dafb0ac25267f07bd46: stopping tablet replica
I20261120 09:03:27.006768 25221 raft_consensus.cc:2440] T e0311b21048c4965ad8ca3cb54bb728d P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Raft consensus shutting down.
I20261120 09:03:27.006974 25221 raft_consensus.cc:2469] T e0311b21048c4965ad8ca3cb54bb728d P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Raft consensus is shut down!
W20261120 09:03:27.007658 25055 catalog_manager.cc:5048] TS 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): delete failed for tablet a8cf83af75c745dc96cb98f99cd2335d because the tablet was not found. No further retry: Not found: Tablet not found: a8cf83af75c745dc96cb98f99cd2335d
W20261120 09:03:27.012040 25055 catalog_manager.cc:5048] TS 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): delete failed for tablet 060080d353484c3a85560b493214e484 because the tablet was not found. No further retry: Not found: Tablet not found: 060080d353484c3a85560b493214e484
I20261120 09:03:27.012689 25221 ts_tablet_manager.cc:1962] T e0311b21048c4965ad8ca3cb54bb728d P 8668dad23e404dafb0ac25267f07bd46: Deleting tablet data with delete state TABLET_DATA_DELETED
W20261120 09:03:27.014945 25055 catalog_manager.cc:5048] TS 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): delete failed for tablet be76b618f4f142849d785428cd83c0f5 because the tablet was not found. No further retry: Not found: Tablet not found: be76b618f4f142849d785428cd83c0f5
I20261120 09:03:27.017891 25071 catalog_manager.cc:3546] renamed table default.table_39131cc9c462405ba3639c841ebfe256 [id=cb55967ea90e43be8da1354763f7984c] in HMS: new name default.table_a63a3233f7d94bf99010f9b0c7cb365e
I20261120 09:03:27.018414 25234 tablet_bootstrap.cc:492] T 26f97270103e4956b82be66244c71301 P 2fb9ff0dc3d849d7bcf95806233d2c62: No bootstrap required, opened a new log
I20261120 09:03:27.018621 25234 ts_tablet_manager.cc:1449] T 26f97270103e4956b82be66244c71301 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent bootstrapping tablet: real 0.193s	user 0.007s	sys 0.000s
I20261120 09:03:27.019497 25234 raft_consensus.cc:366] T 26f97270103e4956b82be66244c71301 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.019721 25234 raft_consensus.cc:392] T 26f97270103e4956b82be66244c71301 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:27.019810 25234 raft_consensus.cc:787] T 26f97270103e4956b82be66244c71301 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Initialized, Role: FOLLOWER
I20261120 09:03:27.020033 25234 consensus_queue.cc:261] T 26f97270103e4956b82be66244c71301 P 2fb9ff0dc3d849d7bcf95806233d2c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.020643 25234 ts_tablet_manager.cc:1480] T 26f97270103e4956b82be66244c71301 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.000s
I20261120 09:03:27.020934 25234 tablet_bootstrap.cc:492] T 18019fa55aae42be8fb9e5421dd45630 P 2fb9ff0dc3d849d7bcf95806233d2c62: Bootstrap starting.
I20261120 09:03:27.023093 25246 tablet.cc:1872] T 707757cc32af4fe98d4a04e6a7498c17 P 2fb9ff0dc3d849d7bcf95806233d2c62: Alter schema from (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    PRIMARY KEY (key)
) version 1
I20261120 09:03:27.024497 24641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 212960af80bf45deb7c508c3356d3391. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:27.037397 25224 tablet_bootstrap.cc:492] T 212960af80bf45deb7c508c3356d3391 P 8668dad23e404dafb0ac25267f07bd46: Bootstrap starting.
I20261120 09:03:27.039487 25224 tablet_bootstrap.cc:654] T 212960af80bf45deb7c508c3356d3391 P 8668dad23e404dafb0ac25267f07bd46: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:27.046041 25220 ts_tablet_manager.cc:1975] T be76b618f4f142849d785428cd83c0f5 P 2fb9ff0dc3d849d7bcf95806233d2c62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20261120 09:03:27.046028 25076 catalog_manager.cc:5956] TS 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677) does not have the latest schema for tablet 18019fa55aae42be8fb9e5421dd45630 (table default.table_0d4b09a9b1754e38bca62e97c14a0854 [id=83bafe99e25046a4a43a3739a3ca07a1]). Expected version 1 got 0
I20261120 09:03:27.046165 25220 log.cc:1199] T be76b618f4f142849d785428cd83c0f5 P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-1/wal/wals/be76b618f4f142849d785428cd83c0f5
I20261120 09:03:27.046228 25076 catalog_manager.cc:5956] TS 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677) does not have the latest schema for tablet 26f97270103e4956b82be66244c71301 (table default.table_39131cc9c462405ba3639c841ebfe256 [id=cb55967ea90e43be8da1354763f7984c]). Expected version 1 got 0
I20261120 09:03:27.046485 25076 catalog_manager.cc:5956] TS 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677) does not have the latest schema for tablet 707757cc32af4fe98d4a04e6a7498c17 (table default.table_4d5337371cd3454fa5aae228272e5fda [id=90570e46cebe47eba97e5b980f23e909]). Expected version 1 got 0
I20261120 09:03:27.049409 25220 ts_tablet_manager.cc:1996] T be76b618f4f142849d785428cd83c0f5 P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting consensus metadata
I20261120 09:03:27.049543 25221 ts_tablet_manager.cc:1975] T e0311b21048c4965ad8ca3cb54bb728d P 8668dad23e404dafb0ac25267f07bd46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20261120 09:03:27.049675 25221 log.cc:1199] T e0311b21048c4965ad8ca3cb54bb728d P 8668dad23e404dafb0ac25267f07bd46: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-2/wal/wals/e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:03:27.050048 25221 ts_tablet_manager.cc:1996] T e0311b21048c4965ad8ca3cb54bb728d P 8668dad23e404dafb0ac25267f07bd46: Deleting consensus metadata
I20261120 09:03:27.054066 25224 tablet_bootstrap.cc:492] T 212960af80bf45deb7c508c3356d3391 P 8668dad23e404dafb0ac25267f07bd46: No bootstrap required, opened a new log
I20261120 09:03:27.054263 25224 ts_tablet_manager.cc:1449] T 212960af80bf45deb7c508c3356d3391 P 8668dad23e404dafb0ac25267f07bd46: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.000s
I20261120 09:03:27.055177 25224 raft_consensus.cc:366] T 212960af80bf45deb7c508c3356d3391 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.055588 25224 raft_consensus.cc:392] T 212960af80bf45deb7c508c3356d3391 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:27.055675 25224 raft_consensus.cc:787] T 212960af80bf45deb7c508c3356d3391 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Initialized, Role: FOLLOWER
I20261120 09:03:27.056094 25224 consensus_queue.cc:261] T 212960af80bf45deb7c508c3356d3391 P 8668dad23e404dafb0ac25267f07bd46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.056948 25055 catalog_manager.cc:5081] TS 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): tablet e0311b21048c4965ad8ca3cb54bb728d (table default.table_b9d5ad28fd144956bd0715d85a6db556 [id=33f431752a024c38910eb2e3d135295a]) successfully deleted
I20261120 09:03:27.060961 25224 ts_tablet_manager.cc:1480] T 212960af80bf45deb7c508c3356d3391 P 8668dad23e404dafb0ac25267f07bd46: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.002s
I20261120 09:03:27.063716 25076 catalog_manager.cc:6409] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: default.table_f9f890b63b384c3b9f30da0ba8a80c03 [id=315bdedf9fe44e5d866534884f65f6d4] alter complete (version 1)
I20261120 09:03:27.064908 25220 tablet_replica.cc:333] T a8cf83af75c745dc96cb98f99cd2335d P 2fb9ff0dc3d849d7bcf95806233d2c62: stopping tablet replica
I20261120 09:03:27.065565 25217 tablet_bootstrap.cc:492] T e0311b21048c4965ad8ca3cb54bb728d P 2c3fe57b9d2c424da181281af303f3c3: No bootstrap required, opened a new log
I20261120 09:03:27.065783 25217 ts_tablet_manager.cc:1449] T e0311b21048c4965ad8ca3cb54bb728d P 2c3fe57b9d2c424da181281af303f3c3: Time spent bootstrapping tablet: real 0.087s	user 0.017s	sys 0.020s
I20261120 09:03:27.066619 25217 raft_consensus.cc:366] T e0311b21048c4965ad8ca3cb54bb728d P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.066885 25217 raft_consensus.cc:392] T e0311b21048c4965ad8ca3cb54bb728d P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:27.067229 25217 raft_consensus.cc:787] T e0311b21048c4965ad8ca3cb54bb728d P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Initialized, Role: FOLLOWER
I20261120 09:03:27.067538 25217 consensus_queue.cc:261] T e0311b21048c4965ad8ca3cb54bb728d P 2c3fe57b9d2c424da181281af303f3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.068369 25217 ts_tablet_manager.cc:1480] T e0311b21048c4965ad8ca3cb54bb728d P 2c3fe57b9d2c424da181281af303f3c3: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.002s
I20261120 09:03:27.068738 25217 tablet_bootstrap.cc:492] T 212960af80bf45deb7c508c3356d3391 P 2c3fe57b9d2c424da181281af303f3c3: Bootstrap starting.
I20261120 09:03:27.068718 24313 catalog_manager.cc:2775] deleted HMS catalog entry for table default.table_d67fc59080cc4194b566604a649aefad [id=ec464d0cd5ec4ec2bc03ebb8a14481e0]
I20261120 09:03:27.069253 24313 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:41728 (request call id 35) took 3183 ms. Trace:
I20261120 09:03:27.069387 24313 rpcz_store.cc:276] 1120 09:03:23.885338 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:25.846233 (+1960895us) service_pool.cc:224] Handling call
1120 09:03:26.601830 (+755597us) catalog_manager.cc:2437] Looking up, locking, and authorizing table
1120 09:03:27.069218 (+467388us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":373655,"Hive Metastore.run_cpu_time_us":208,"Hive Metastore.run_wall_time_us":92843}
I20261120 09:03:27.070672 25217 tablet_bootstrap.cc:654] T 212960af80bf45deb7c508c3356d3391 P 2c3fe57b9d2c424da181281af303f3c3: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:27.078971 25217 tablet_bootstrap.cc:492] T 212960af80bf45deb7c508c3356d3391 P 2c3fe57b9d2c424da181281af303f3c3: No bootstrap required, opened a new log
I20261120 09:03:27.079149 25217 ts_tablet_manager.cc:1449] T 212960af80bf45deb7c508c3356d3391 P 2c3fe57b9d2c424da181281af303f3c3: Time spent bootstrapping tablet: real 0.010s	user 0.004s	sys 0.005s
I20261120 09:03:27.080045 25217 raft_consensus.cc:366] T 212960af80bf45deb7c508c3356d3391 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.080253 25217 raft_consensus.cc:392] T 212960af80bf45deb7c508c3356d3391 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:27.080338 25217 raft_consensus.cc:787] T 212960af80bf45deb7c508c3356d3391 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Initialized, Role: FOLLOWER
I20261120 09:03:27.080613 25217 consensus_queue.cc:261] T 212960af80bf45deb7c508c3356d3391 P 2c3fe57b9d2c424da181281af303f3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.083288 25217 ts_tablet_manager.cc:1480] T 212960af80bf45deb7c508c3356d3391 P 2c3fe57b9d2c424da181281af303f3c3: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.000s
I20261120 09:03:27.084125 25076 catalog_manager.cc:6409] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: default.table_784f78c485a74606a638a81633a149e7 [id=aa6cfb171b4c482caa17d7c0862da3d0] alter complete (version 1)
I20261120 09:03:27.084972 24486 tablet_service.cc:1542] Processing DeleteTablet for tablet a8cf83af75c745dc96cb98f99cd2335d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-11-20 09:03:26 UTC) from {username='slave'} at 127.0.0.1:50052
I20261120 09:03:27.085930 24486 tablet_service.cc:1542] Processing DeleteTablet for tablet 060080d353484c3a85560b493214e484 with delete_type TABLET_DATA_DELETED (replaced by tablet 18019fa55aae42be8fb9e5421dd45630) from {username='slave'} at 127.0.0.1:50052
W20261120 09:03:27.087100 25055 catalog_manager.cc:5048] TS 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): delete failed for tablet a8cf83af75c745dc96cb98f99cd2335d because the tablet was not found. No further retry: Not found: Tablet not found: a8cf83af75c745dc96cb98f99cd2335d
W20261120 09:03:27.087419 25055 catalog_manager.cc:5048] TS 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): delete failed for tablet 060080d353484c3a85560b493214e484 because the tablet was not found. No further retry: Not found: Tablet not found: 060080d353484c3a85560b493214e484
I20261120 09:03:27.087966 25076 catalog_manager.cc:5956] TS 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879) does not have the latest schema for tablet 18019fa55aae42be8fb9e5421dd45630 (table default.table_0d4b09a9b1754e38bca62e97c14a0854 [id=83bafe99e25046a4a43a3739a3ca07a1]). Expected version 1 got 0
I20261120 09:03:27.088200 25076 catalog_manager.cc:5956] TS 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879) does not have the latest schema for tablet 26f97270103e4956b82be66244c71301 (table default.table_39131cc9c462405ba3639c841ebfe256 [id=cb55967ea90e43be8da1354763f7984c]). Expected version 1 got 0
I20261120 09:03:27.089574 25076 catalog_manager.cc:5956] TS 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879) does not have the latest schema for tablet 707757cc32af4fe98d4a04e6a7498c17 (table default.table_4d5337371cd3454fa5aae228272e5fda [id=90570e46cebe47eba97e5b980f23e909]). Expected version 1 got 0
I20261120 09:03:27.094940 25076 catalog_manager.cc:5956] TS 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035) does not have the latest schema for tablet 18019fa55aae42be8fb9e5421dd45630 (table default.table_0d4b09a9b1754e38bca62e97c14a0854 [id=83bafe99e25046a4a43a3739a3ca07a1]). Expected version 1 got 0
I20261120 09:03:27.095227 25076 catalog_manager.cc:5956] TS 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035) does not have the latest schema for tablet 26f97270103e4956b82be66244c71301 (table default.table_39131cc9c462405ba3639c841ebfe256 [id=cb55967ea90e43be8da1354763f7984c]). Expected version 1 got 0
I20261120 09:03:27.097965 24638 tablet_service.cc:1542] Processing DeleteTablet for tablet be76b618f4f142849d785428cd83c0f5 with delete_type TABLET_DATA_DELETED (replaced by tablet e0311b21048c4965ad8ca3cb54bb728d) from {username='slave'} at 127.0.0.1:40178
I20261120 09:03:27.101257 25234 tablet_bootstrap.cc:654] T 18019fa55aae42be8fb9e5421dd45630 P 2fb9ff0dc3d849d7bcf95806233d2c62: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:27.105516 25076 catalog_manager.cc:6409] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: default.table_4d5337371cd3454fa5aae228272e5fda [id=90570e46cebe47eba97e5b980f23e909] alter complete (version 1)
I20261120 09:03:27.108598 25076 catalog_manager.cc:5956] TS 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677) does not have the latest schema for tablet 18019fa55aae42be8fb9e5421dd45630 (table default.table_0d4b09a9b1754e38bca62e97c14a0854 [id=83bafe99e25046a4a43a3739a3ca07a1]). Expected version 1 got 0
I20261120 09:03:27.108922 25076 catalog_manager.cc:5956] TS 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677) does not have the latest schema for tablet 26f97270103e4956b82be66244c71301 (table default.table_39131cc9c462405ba3639c841ebfe256 [id=cb55967ea90e43be8da1354763f7984c]). Expected version 1 got 0
I20261120 09:03:27.108909 24784 tablet_service.cc:1542] Processing DeleteTablet for tablet e0311b21048c4965ad8ca3cb54bb728d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-11-20 09:03:26 UTC) from {username='slave'} at 127.0.0.1:43964
W20261120 09:03:27.109530 25055 catalog_manager.cc:5048] TS 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): delete failed for tablet e0311b21048c4965ad8ca3cb54bb728d because the tablet was not found. No further retry: Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:03:27.109680 25220 raft_consensus.cc:2440] T a8cf83af75c745dc96cb98f99cd2335d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20261120 09:03:27.110386 25220 raft_consensus.cc:2469] T a8cf83af75c745dc96cb98f99cd2335d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20261120 09:03:27.111272 24486 tablet_service.cc:1542] Processing DeleteTablet for tablet e0311b21048c4965ad8ca3cb54bb728d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-11-20 09:03:26 UTC) from {username='slave'} at 127.0.0.1:50052
I20261120 09:03:27.111613 25215 tablet_replica.cc:333] T e0311b21048c4965ad8ca3cb54bb728d P 2c3fe57b9d2c424da181281af303f3c3: stopping tablet replica
I20261120 09:03:27.111809 25215 raft_consensus.cc:2440] T e0311b21048c4965ad8ca3cb54bb728d P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20261120 09:03:27.112005 25215 raft_consensus.cc:2469] T e0311b21048c4965ad8ca3cb54bb728d P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20261120 09:03:27.112464 25220 ts_tablet_manager.cc:1962] T a8cf83af75c745dc96cb98f99cd2335d P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261120 09:03:27.112552 25076 catalog_manager.cc:5956] TS 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879) does not have the latest schema for tablet 26f97270103e4956b82be66244c71301 (table default.table_39131cc9c462405ba3639c841ebfe256 [id=cb55967ea90e43be8da1354763f7984c]). Expected version 1 got 0
I20261120 09:03:27.112859 25215 ts_tablet_manager.cc:1962] T e0311b21048c4965ad8ca3cb54bb728d P 2c3fe57b9d2c424da181281af303f3c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20261120 09:03:27.114910 25076 catalog_manager.cc:3588] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59800:
table { table_name: "default.Table_f0940064a6844fdaadb8859f4257b11f" } new_table_name: "default.Table_8c110d08c07849d38b1899056ea665a6" modify_external_catalogs: true
I20261120 09:03:27.119475 25215 ts_tablet_manager.cc:1975] T e0311b21048c4965ad8ca3cb54bb728d P 2c3fe57b9d2c424da181281af303f3c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20261120 09:03:27.119690 25215 log.cc:1199] T e0311b21048c4965ad8ca3cb54bb728d P 2c3fe57b9d2c424da181281af303f3c3: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-0/wal/wals/e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:03:27.120155 25215 ts_tablet_manager.cc:1996] T e0311b21048c4965ad8ca3cb54bb728d P 2c3fe57b9d2c424da181281af303f3c3: Deleting consensus metadata
I20261120 09:03:27.121986 25055 catalog_manager.cc:5081] TS 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): tablet e0311b21048c4965ad8ca3cb54bb728d (table default.table_b9d5ad28fd144956bd0715d85a6db556 [id=33f431752a024c38910eb2e3d135295a]) successfully deleted
I20261120 09:03:27.126071 25220 ts_tablet_manager.cc:1975] T a8cf83af75c745dc96cb98f99cd2335d P 2fb9ff0dc3d849d7bcf95806233d2c62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20261120 09:03:27.126205 25220 log.cc:1199] T a8cf83af75c745dc96cb98f99cd2335d P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting WAL directory at /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/ts-1/wal/wals/a8cf83af75c745dc96cb98f99cd2335d
I20261120 09:03:27.130496 25220 ts_tablet_manager.cc:1996] T a8cf83af75c745dc96cb98f99cd2335d P 2fb9ff0dc3d849d7bcf95806233d2c62: Deleting consensus metadata
I20261120 09:03:27.131593 25057 catalog_manager.cc:5081] TS 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): tablet a8cf83af75c745dc96cb98f99cd2335d (table default.table_c97aaa8fd7f446ed8008a6bcecc8b494 [id=f94e62db1de54fcf92c9c893f1a073cf]) successfully deleted
W20261120 09:03:27.132341 25057 catalog_manager.cc:5061] TS 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): delete failed for tablet e0311b21048c4965ad8ca3cb54bb728d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e0311b21048c4965ad8ca3cb54bb728d already in progress: creating tablet
I20261120 09:03:27.134752 24321 catalog_manager.cc:2218] created HMS catalog entry for table  [id=30da2006c3bb45c2b945f08d7cbe6945]
W20261120 09:03:27.134891 25057 catalog_manager.cc:5048] TS 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): delete failed for tablet be76b618f4f142849d785428cd83c0f5 because the tablet was not found. No further retry: Not found: Tablet not found: be76b618f4f142849d785428cd83c0f5
W20261120 09:03:27.135705 24321 catalog_manager.cc:2246] Illegal state: an error occurred while writing to the sys-catalog: replica d82bf27d60fa450e8f941d1a9d36a825 is not leader of this config: current role FOLLOWER
I20261120 09:03:27.136276 25234 tablet_bootstrap.cc:492] T 18019fa55aae42be8fb9e5421dd45630 P 2fb9ff0dc3d849d7bcf95806233d2c62: No bootstrap required, opened a new log
I20261120 09:03:27.136837 25234 ts_tablet_manager.cc:1449] T 18019fa55aae42be8fb9e5421dd45630 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent bootstrapping tablet: real 0.116s	user 0.008s	sys 0.000s
I20261120 09:03:27.137593 25234 raft_consensus.cc:366] T 18019fa55aae42be8fb9e5421dd45630 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.137778 25234 raft_consensus.cc:392] T 18019fa55aae42be8fb9e5421dd45630 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:27.137838 25234 raft_consensus.cc:787] T 18019fa55aae42be8fb9e5421dd45630 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Initialized, Role: FOLLOWER
I20261120 09:03:27.139362 25234 consensus_queue.cc:261] T 18019fa55aae42be8fb9e5421dd45630 P 2fb9ff0dc3d849d7bcf95806233d2c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.142414 25080 catalog_manager.cc:2218] created HMS catalog entry for table  [id=55152bf51e49475ea6391839e6630cd0]
I20261120 09:03:27.151402 25233 raft_consensus.cc:534] T 212960af80bf45deb7c508c3356d3391 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:27.151585 25233 raft_consensus.cc:556] T 212960af80bf45deb7c508c3356d3391 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.152340 25233 leader_election.cc:290] T 212960af80bf45deb7c508c3356d3391 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:27.152979 24508 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "212960af80bf45deb7c508c3356d3391" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3" is_pre_election: true
I20261120 09:03:27.153030 24661 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "212960af80bf45deb7c508c3356d3391" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" is_pre_election: true
I20261120 09:03:27.153227 24508 raft_consensus.cc:2062] T 212960af80bf45deb7c508c3356d3391 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 8668dad23e404dafb0ac25267f07bd46 in term 0
W20261120 09:03:27.153635 24744 leader_election.cc:343] T 212960af80bf45deb7c508c3356d3391 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): Illegal state: must be running to vote when last-logged opid is not known
I20261120 09:03:27.153829 24744 leader_election.cc:304] T 212960af80bf45deb7c508c3356d3391 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46; no voters: 2fb9ff0dc3d849d7bcf95806233d2c62
I20261120 09:03:27.157624 25080 catalog_manager.cc:5956] TS 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879) does not have the latest schema for tablet 18019fa55aae42be8fb9e5421dd45630 (table default.table_0d4b09a9b1754e38bca62e97c14a0854 [id=83bafe99e25046a4a43a3739a3ca07a1]). Expected version 1 got 0
I20261120 09:03:27.158321 25080 catalog_manager.cc:2551] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59800:
table { table_name: "default.Table_4d5337371cd3454fa5aae228272e5fda" } modify_external_catalogs: true
I20261120 09:03:27.158535 25080 catalog_manager.cc:2799] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59800:
table { table_name: "default.Table_4d5337371cd3454fa5aae228272e5fda" } modify_external_catalogs: true
I20261120 09:03:27.166049 25233 raft_consensus.cc:3024] T 212960af80bf45deb7c508c3356d3391 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261120 09:03:27.166172 25233 raft_consensus.cc:534] T 212960af80bf45deb7c508c3356d3391 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261120 09:03:27.166239 25233 raft_consensus.cc:3296] T 212960af80bf45deb7c508c3356d3391 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:27.166502 25233 raft_consensus.cc:556] T 212960af80bf45deb7c508c3356d3391 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.173451 25233 leader_election.cc:290] T 212960af80bf45deb7c508c3356d3391 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 election: Requested vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:27.174283 24508 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "212960af80bf45deb7c508c3356d3391" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3"
I20261120 09:03:27.174558 24508 raft_consensus.cc:3296] T 212960af80bf45deb7c508c3356d3391 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:27.175007 24508 raft_consensus.cc:2062] T 212960af80bf45deb7c508c3356d3391 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 8668dad23e404dafb0ac25267f07bd46 in term 1
I20261120 09:03:27.178753 24661 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "212960af80bf45deb7c508c3356d3391" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62"
W20261120 09:03:27.179563 24744 leader_election.cc:343] T 212960af80bf45deb7c508c3356d3391 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): Illegal state: must be running to vote when last-logged opid is not known
I20261120 09:03:27.180135 24742 leader_election.cc:304] T 212960af80bf45deb7c508c3356d3391 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46; no voters: 2fb9ff0dc3d849d7bcf95806233d2c62
I20261120 09:03:27.184643 24641 tablet_service.cc:1495] Processing CreateTablet for tablet 0bac0a6b89f34c549c5118605ed0acbf (DEFAULT_TABLE table=default.table_414553f5c3994f4097d7fdbf9dc01082 [id=55152bf51e49475ea6391839e6630cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:27.185067 24641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bac0a6b89f34c549c5118605ed0acbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:27.187549 24784 tablet_service.cc:1495] Processing CreateTablet for tablet 0bac0a6b89f34c549c5118605ed0acbf (DEFAULT_TABLE table=default.table_414553f5c3994f4097d7fdbf9dc01082 [id=55152bf51e49475ea6391839e6630cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:27.187557 24486 tablet_service.cc:1495] Processing CreateTablet for tablet 0bac0a6b89f34c549c5118605ed0acbf (DEFAULT_TABLE table=default.table_414553f5c3994f4097d7fdbf9dc01082 [id=55152bf51e49475ea6391839e6630cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:27.187968 24784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bac0a6b89f34c549c5118605ed0acbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:27.188009 24486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bac0a6b89f34c549c5118605ed0acbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:27.189325 25081 catalog_manager.cc:2218] created HMS catalog entry for table  [id=d16648dc14594d6db8143aaa02f420a5]
I20261120 09:03:27.194772 25217 tablet_bootstrap.cc:492] T 0bac0a6b89f34c549c5118605ed0acbf P 2c3fe57b9d2c424da181281af303f3c3: Bootstrap starting.
I20261120 09:03:27.196462 25217 tablet_bootstrap.cc:654] T 0bac0a6b89f34c549c5118605ed0acbf P 2c3fe57b9d2c424da181281af303f3c3: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:27.196439 25233 raft_consensus.cc:3024] T 212960af80bf45deb7c508c3356d3391 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Leader election won for term 1
I20261120 09:03:27.196600 25233 raft_consensus.cc:744] T 212960af80bf45deb7c508c3356d3391 P 8668dad23e404dafb0ac25267f07bd46 [term 1 LEADER]: Becoming Leader. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Running, Role: LEADER
I20261120 09:03:27.196902 25233 consensus_queue.cc:238] T 212960af80bf45deb7c508c3356d3391 P 8668dad23e404dafb0ac25267f07bd46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.210134 25224 tablet_bootstrap.cc:492] T 0bac0a6b89f34c549c5118605ed0acbf P 8668dad23e404dafb0ac25267f07bd46: Bootstrap starting.
I20261120 09:03:27.212320 25224 tablet_bootstrap.cc:654] T 0bac0a6b89f34c549c5118605ed0acbf P 8668dad23e404dafb0ac25267f07bd46: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:27.213166 25234 ts_tablet_manager.cc:1480] T 18019fa55aae42be8fb9e5421dd45630 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent starting tablet: real 0.076s	user 0.003s	sys 0.000s
I20261120 09:03:27.213557 25234 tablet_bootstrap.cc:492] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62: Bootstrap starting.
I20261120 09:03:27.213688 25081 catalog_manager.cc:3588] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59800:
table { table_name: "default.Table_797fe36dbbf14c0c8e085d8470e75a24" } new_table_name: "default.Table_e3eb0aafb8fb4ce983b29a55f8b42aac" modify_external_catalogs: true
I20261120 09:03:27.215234 25234 tablet_bootstrap.cc:654] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:27.233369 25070 catalog_manager.cc:2218] created HMS catalog entry for table  [id=0bfc8c6dc2e94a92b142bee12f2b88e8]
I20261120 09:03:27.234906 24315 catalog_manager.cc:2218] created HMS catalog entry for table  [id=7509b508c8334915b8f08e6922eb5f81]
W20261120 09:03:27.235566 24744 consensus_peers.cc:597] T 212960af80bf45deb7c508c3356d3391 P 8668dad23e404dafb0ac25267f07bd46 -> Peer 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): Couldn't send request to peer 2fb9ff0dc3d849d7bcf95806233d2c62. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20261120 09:03:27.235671 24315 catalog_manager.cc:2246] Illegal state: an error occurred while writing to the sys-catalog: replica d82bf27d60fa450e8f941d1a9d36a825 is not leader of this config: current role FOLLOWER
I20261120 09:03:27.236064 25262 consensus_queue.cc:1049] T 212960af80bf45deb7c508c3356d3391 P 8668dad23e404dafb0ac25267f07bd46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:27.244424 25224 tablet_bootstrap.cc:492] T 0bac0a6b89f34c549c5118605ed0acbf P 8668dad23e404dafb0ac25267f07bd46: No bootstrap required, opened a new log
I20261120 09:03:27.244575 25224 ts_tablet_manager.cc:1449] T 0bac0a6b89f34c549c5118605ed0acbf P 8668dad23e404dafb0ac25267f07bd46: Time spent bootstrapping tablet: real 0.035s	user 0.006s	sys 0.003s
I20261120 09:03:27.245311 25224 raft_consensus.cc:366] T 0bac0a6b89f34c549c5118605ed0acbf P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.245489 25224 raft_consensus.cc:392] T 0bac0a6b89f34c549c5118605ed0acbf P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:27.245577 25224 raft_consensus.cc:787] T 0bac0a6b89f34c549c5118605ed0acbf P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Initialized, Role: FOLLOWER
I20261120 09:03:27.245819 25224 consensus_queue.cc:261] T 0bac0a6b89f34c549c5118605ed0acbf P 8668dad23e404dafb0ac25267f07bd46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.246331 25224 ts_tablet_manager.cc:1480] T 0bac0a6b89f34c549c5118605ed0acbf P 8668dad23e404dafb0ac25267f07bd46: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.000s
I20261120 09:03:27.251731 25217 tablet_bootstrap.cc:492] T 0bac0a6b89f34c549c5118605ed0acbf P 2c3fe57b9d2c424da181281af303f3c3: No bootstrap required, opened a new log
I20261120 09:03:27.251914 25217 ts_tablet_manager.cc:1449] T 0bac0a6b89f34c549c5118605ed0acbf P 2c3fe57b9d2c424da181281af303f3c3: Time spent bootstrapping tablet: real 0.057s	user 0.004s	sys 0.008s
I20261120 09:03:27.257030 25262 raft_consensus.cc:534] T 18019fa55aae42be8fb9e5421dd45630 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:27.257256 25262 raft_consensus.cc:556] T 18019fa55aae42be8fb9e5421dd45630 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.258129 25262 leader_election.cc:290] T 18019fa55aae42be8fb9e5421dd45630 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:27.259006 24509 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "18019fa55aae42be8fb9e5421dd45630" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3" is_pre_election: true
I20261120 09:03:27.259352 24509 raft_consensus.cc:2062] T 18019fa55aae42be8fb9e5421dd45630 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 8668dad23e404dafb0ac25267f07bd46 in term 0
I20261120 09:03:27.259925 24742 leader_election.cc:304] T 18019fa55aae42be8fb9e5421dd45630 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46; no voters: 
I20261120 09:03:27.262719 25217 raft_consensus.cc:366] T 0bac0a6b89f34c549c5118605ed0acbf P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.262877 25217 raft_consensus.cc:392] T 0bac0a6b89f34c549c5118605ed0acbf P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:27.262955 25217 raft_consensus.cc:787] T 0bac0a6b89f34c549c5118605ed0acbf P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Initialized, Role: FOLLOWER
I20261120 09:03:27.263070 25262 raft_consensus.cc:3024] T 18019fa55aae42be8fb9e5421dd45630 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261120 09:03:27.263175 25262 raft_consensus.cc:534] T 18019fa55aae42be8fb9e5421dd45630 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261120 09:03:27.263273 25262 raft_consensus.cc:3296] T 18019fa55aae42be8fb9e5421dd45630 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:27.263516 25262 raft_consensus.cc:556] T 18019fa55aae42be8fb9e5421dd45630 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.264346 24661 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "18019fa55aae42be8fb9e5421dd45630" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" is_pre_election: true
I20261120 09:03:27.264623 24661 raft_consensus.cc:2062] T 18019fa55aae42be8fb9e5421dd45630 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 8668dad23e404dafb0ac25267f07bd46 in term 0
I20261120 09:03:27.264957 25217 consensus_queue.cc:261] T 0bac0a6b89f34c549c5118605ed0acbf P 2c3fe57b9d2c424da181281af303f3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.265653 25217 ts_tablet_manager.cc:1480] T 0bac0a6b89f34c549c5118605ed0acbf P 2c3fe57b9d2c424da181281af303f3c3: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.001s
I20261120 09:03:27.270473 25262 leader_election.cc:290] T 18019fa55aae42be8fb9e5421dd45630 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 election: Requested vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:27.271883 24509 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "18019fa55aae42be8fb9e5421dd45630" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3"
I20261120 09:03:27.272120 24509 raft_consensus.cc:3296] T 18019fa55aae42be8fb9e5421dd45630 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:27.272532 24509 raft_consensus.cc:2062] T 18019fa55aae42be8fb9e5421dd45630 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 8668dad23e404dafb0ac25267f07bd46 in term 1
I20261120 09:03:27.277379 24661 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "18019fa55aae42be8fb9e5421dd45630" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62"
I20261120 09:03:27.277603 24661 raft_consensus.cc:3296] T 18019fa55aae42be8fb9e5421dd45630 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:27.277709 24742 leader_election.cc:304] T 18019fa55aae42be8fb9e5421dd45630 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46; no voters: 
I20261120 09:03:27.277904 24661 raft_consensus.cc:2062] T 18019fa55aae42be8fb9e5421dd45630 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 8668dad23e404dafb0ac25267f07bd46 in term 1
I20261120 09:03:27.282707 25262 raft_consensus.cc:3024] T 18019fa55aae42be8fb9e5421dd45630 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Leader election won for term 1
I20261120 09:03:27.282887 25262 raft_consensus.cc:744] T 18019fa55aae42be8fb9e5421dd45630 P 8668dad23e404dafb0ac25267f07bd46 [term 1 LEADER]: Becoming Leader. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Running, Role: LEADER
I20261120 09:03:27.283154 25262 consensus_queue.cc:238] T 18019fa55aae42be8fb9e5421dd45630 P 8668dad23e404dafb0ac25267f07bd46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.291258 24641 tablet_service.cc:1495] Processing CreateTablet for tablet 565df75f345947bea84b343c454ea1be (DEFAULT_TABLE table=default.table_1a335d2b826a4f21a34ac38ad85ff200 [id=d16648dc14594d6db8143aaa02f420a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:27.291776 24641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 565df75f345947bea84b343c454ea1be. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:27.292030 24486 tablet_service.cc:1495] Processing CreateTablet for tablet 565df75f345947bea84b343c454ea1be (DEFAULT_TABLE table=default.table_1a335d2b826a4f21a34ac38ad85ff200 [id=d16648dc14594d6db8143aaa02f420a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:27.292481 24486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 565df75f345947bea84b343c454ea1be. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:27.299597 25217 tablet_bootstrap.cc:492] T 565df75f345947bea84b343c454ea1be P 2c3fe57b9d2c424da181281af303f3c3: Bootstrap starting.
I20261120 09:03:27.301277 25217 tablet_bootstrap.cc:654] T 565df75f345947bea84b343c454ea1be P 2c3fe57b9d2c424da181281af303f3c3: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:27.310497 24784 tablet_service.cc:1495] Processing CreateTablet for tablet 565df75f345947bea84b343c454ea1be (DEFAULT_TABLE table=default.table_1a335d2b826a4f21a34ac38ad85ff200 [id=d16648dc14594d6db8143aaa02f420a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:27.311086 24784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 565df75f345947bea84b343c454ea1be. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:27.319537 25217 tablet_bootstrap.cc:492] T 565df75f345947bea84b343c454ea1be P 2c3fe57b9d2c424da181281af303f3c3: No bootstrap required, opened a new log
I20261120 09:03:27.319702 25217 ts_tablet_manager.cc:1449] T 565df75f345947bea84b343c454ea1be P 2c3fe57b9d2c424da181281af303f3c3: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.005s
I20261120 09:03:27.320426 25217 raft_consensus.cc:366] T 565df75f345947bea84b343c454ea1be P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.320608 25217 raft_consensus.cc:392] T 565df75f345947bea84b343c454ea1be P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:27.320685 25217 raft_consensus.cc:787] T 565df75f345947bea84b343c454ea1be P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Initialized, Role: FOLLOWER
I20261120 09:03:27.321022 25217 consensus_queue.cc:261] T 565df75f345947bea84b343c454ea1be P 2c3fe57b9d2c424da181281af303f3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.321499 25217 ts_tablet_manager.cc:1480] T 565df75f345947bea84b343c454ea1be P 2c3fe57b9d2c424da181281af303f3c3: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.001s
I20261120 09:03:27.332485 25224 tablet_bootstrap.cc:492] T 565df75f345947bea84b343c454ea1be P 8668dad23e404dafb0ac25267f07bd46: Bootstrap starting.
I20261120 09:03:27.334079 25224 tablet_bootstrap.cc:654] T 565df75f345947bea84b343c454ea1be P 8668dad23e404dafb0ac25267f07bd46: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:27.340292 25070 catalog_manager.cc:5956] TS 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879) does not have the latest schema for tablet 18019fa55aae42be8fb9e5421dd45630 (table default.table_0d4b09a9b1754e38bca62e97c14a0854 [id=83bafe99e25046a4a43a3739a3ca07a1]). Expected version 1 got 0
I20261120 09:03:27.343659 25070 catalog_manager.cc:5856] T 212960af80bf45deb7c508c3356d3391 P 8668dad23e404dafb0ac25267f07bd46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67). New cstate: current_term: 1 leader_uuid: "8668dad23e404dafb0ac25267f07bd46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } health_report { overall_health: UNKNOWN } } }
I20261120 09:03:27.353039 25079 catalog_manager.cc:2775] deleted HMS catalog entry for table default.table_b2351eb1045a47feb0ca7b7422706581 [id=268c82ae3c7448059e7674f73aad3114]
I20261120 09:03:27.366662 25233 consensus_queue.cc:1049] T 18019fa55aae42be8fb9e5421dd45630 P 8668dad23e404dafb0ac25267f07bd46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:27.372584 24969 raft_consensus.cc:534] T 0bac0a6b89f34c549c5118605ed0acbf P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:27.372782 24969 raft_consensus.cc:556] T 0bac0a6b89f34c549c5118605ed0acbf P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.373123 25224 tablet_bootstrap.cc:492] T 565df75f345947bea84b343c454ea1be P 8668dad23e404dafb0ac25267f07bd46: No bootstrap required, opened a new log
I20261120 09:03:27.373180 25233 consensus_queue.cc:1049] T 18019fa55aae42be8fb9e5421dd45630 P 8668dad23e404dafb0ac25267f07bd46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:27.373543 24969 leader_election.cc:290] T 0bac0a6b89f34c549c5118605ed0acbf P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:27.374167 24661 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "0bac0a6b89f34c549c5118605ed0acbf" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" is_pre_election: true
I20261120 09:03:27.374321 24808 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "0bac0a6b89f34c549c5118605ed0acbf" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46" is_pre_election: true
I20261120 09:03:27.374570 24808 raft_consensus.cc:2062] T 0bac0a6b89f34c549c5118605ed0acbf P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 0
I20261120 09:03:27.375047 24443 leader_election.cc:304] T 0bac0a6b89f34c549c5118605ed0acbf P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46; no voters: 
I20261120 09:03:27.375293 24969 raft_consensus.cc:3024] T 0bac0a6b89f34c549c5118605ed0acbf P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261120 09:03:27.375418 24969 raft_consensus.cc:534] T 0bac0a6b89f34c549c5118605ed0acbf P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261120 09:03:27.375505 24969 raft_consensus.cc:3296] T 0bac0a6b89f34c549c5118605ed0acbf P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Advancing to term 1
W20261120 09:03:27.375545 24445 leader_election.cc:343] T 0bac0a6b89f34c549c5118605ed0acbf P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): Illegal state: must be running to vote when last-logged opid is not known
I20261120 09:03:27.375774 24969 raft_consensus.cc:556] T 0bac0a6b89f34c549c5118605ed0acbf P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.380178 24969 leader_election.cc:290] T 0bac0a6b89f34c549c5118605ed0acbf P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 election: Requested vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:27.381135 24661 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "0bac0a6b89f34c549c5118605ed0acbf" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62"
W20261120 09:03:27.381971 24445 leader_election.cc:343] T 0bac0a6b89f34c549c5118605ed0acbf P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): Illegal state: must be running to vote when last-logged opid is not known
I20261120 09:03:27.382473 24808 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "0bac0a6b89f34c549c5118605ed0acbf" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46"
I20261120 09:03:27.382700 24808 raft_consensus.cc:3296] T 0bac0a6b89f34c549c5118605ed0acbf P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:27.383015 24808 raft_consensus.cc:2062] T 0bac0a6b89f34c549c5118605ed0acbf P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 1
I20261120 09:03:27.373309 25224 ts_tablet_manager.cc:1449] T 565df75f345947bea84b343c454ea1be P 8668dad23e404dafb0ac25267f07bd46: Time spent bootstrapping tablet: real 0.041s	user 0.003s	sys 0.007s
I20261120 09:03:27.389101 24443 leader_election.cc:304] T 0bac0a6b89f34c549c5118605ed0acbf P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46; no voters: 2fb9ff0dc3d849d7bcf95806233d2c62
I20261120 09:03:27.389418 25240 raft_consensus.cc:3024] T 0bac0a6b89f34c549c5118605ed0acbf P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Leader election won for term 1
I20261120 09:03:27.389554 25240 raft_consensus.cc:744] T 0bac0a6b89f34c549c5118605ed0acbf P 2c3fe57b9d2c424da181281af303f3c3 [term 1 LEADER]: Becoming Leader. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Running, Role: LEADER
I20261120 09:03:27.389870 25240 consensus_queue.cc:238] T 0bac0a6b89f34c549c5118605ed0acbf P 2c3fe57b9d2c424da181281af303f3c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.390306 25224 raft_consensus.cc:366] T 565df75f345947bea84b343c454ea1be P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.390568 25224 raft_consensus.cc:392] T 565df75f345947bea84b343c454ea1be P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:27.390667 25224 raft_consensus.cc:787] T 565df75f345947bea84b343c454ea1be P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Initialized, Role: FOLLOWER
I20261120 09:03:27.391019 25224 consensus_queue.cc:261] T 565df75f345947bea84b343c454ea1be P 8668dad23e404dafb0ac25267f07bd46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.391443 24969 raft_consensus.cc:534] T 565df75f345947bea84b343c454ea1be P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:27.391574 24969 raft_consensus.cc:556] T 565df75f345947bea84b343c454ea1be P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.391671 25224 ts_tablet_manager.cc:1480] T 565df75f345947bea84b343c454ea1be P 8668dad23e404dafb0ac25267f07bd46: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.002s
I20261120 09:03:27.392179 24969 leader_election.cc:290] T 565df75f345947bea84b343c454ea1be P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:27.392859 24661 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "565df75f345947bea84b343c454ea1be" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" is_pre_election: true
W20261120 09:03:27.393584 24445 leader_election.cc:343] T 565df75f345947bea84b343c454ea1be P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): Illegal state: must be running to vote when last-logged opid is not known
I20261120 09:03:27.394392 24808 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "565df75f345947bea84b343c454ea1be" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46" is_pre_election: true
I20261120 09:03:27.394627 24808 raft_consensus.cc:2062] T 565df75f345947bea84b343c454ea1be P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 0
I20261120 09:03:27.395125 24443 leader_election.cc:304] T 565df75f345947bea84b343c454ea1be P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46; no voters: 2fb9ff0dc3d849d7bcf95806233d2c62
I20261120 09:03:27.395584 24969 raft_consensus.cc:3024] T 565df75f345947bea84b343c454ea1be P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261120 09:03:27.395717 24969 raft_consensus.cc:534] T 565df75f345947bea84b343c454ea1be P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261120 09:03:27.395815 24969 raft_consensus.cc:3296] T 565df75f345947bea84b343c454ea1be P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:27.396148 24969 raft_consensus.cc:556] T 565df75f345947bea84b343c454ea1be P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.406946 25077 catalog_manager.cc:2218] created HMS catalog entry for table  [id=35553b36397740a29f2588fd2a840c61]
I20261120 09:03:27.411245 25070 catalog_manager.cc:3588] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59800:
table { table_name: "default.Table_784f78c485a74606a638a81633a149e7" } new_table_name: "default.Table_3e6cd5f501fe4b5fbf59c65130fb50ee" modify_external_catalogs: true
I20261120 09:03:27.419251 24969 leader_election.cc:290] T 565df75f345947bea84b343c454ea1be P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 election: Requested vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:27.420457 24661 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "565df75f345947bea84b343c454ea1be" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62"
I20261120 09:03:27.420989 24808 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "565df75f345947bea84b343c454ea1be" candidate_uuid: "2c3fe57b9d2c424da181281af303f3c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46"
I20261120 09:03:27.421198 24808 raft_consensus.cc:3296] T 565df75f345947bea84b343c454ea1be P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:27.421514 24808 raft_consensus.cc:2062] T 565df75f345947bea84b343c454ea1be P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 2c3fe57b9d2c424da181281af303f3c3 in term 1
W20261120 09:03:27.422544 24445 leader_election.cc:343] T 565df75f345947bea84b343c454ea1be P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): Illegal state: must be running to vote when last-logged opid is not known
I20261120 09:03:27.425904 24443 leader_election.cc:304] T 565df75f345947bea84b343c454ea1be P 2c3fe57b9d2c424da181281af303f3c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46; no voters: 2fb9ff0dc3d849d7bcf95806233d2c62
I20261120 09:03:27.426599 24969 raft_consensus.cc:3024] T 565df75f345947bea84b343c454ea1be P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Leader election won for term 1
I20261120 09:03:27.432968 24641 tablet_service.cc:1495] Processing CreateTablet for tablet 2ee53da425f54c4aaed62a9211d5c2f9 (DEFAULT_TABLE table=default.table_5b01ae1724c5451c8ac9c936c5c8c983 [id=0bfc8c6dc2e94a92b142bee12f2b88e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:27.433460 24641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ee53da425f54c4aaed62a9211d5c2f9. 1 dirs total, 0 dirs full, 0 dirs failed
W20261120 09:03:27.440889 24445 consensus_peers.cc:597] T 0bac0a6b89f34c549c5118605ed0acbf P 2c3fe57b9d2c424da181281af303f3c3 -> Peer 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): Couldn't send request to peer 2fb9ff0dc3d849d7bcf95806233d2c62. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20261120 09:03:27.441310 24969 raft_consensus.cc:744] T 565df75f345947bea84b343c454ea1be P 2c3fe57b9d2c424da181281af303f3c3 [term 1 LEADER]: Becoming Leader. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Running, Role: LEADER
I20261120 09:03:27.441716 24969 consensus_queue.cc:238] T 565df75f345947bea84b343c454ea1be P 2c3fe57b9d2c424da181281af303f3c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.444416 25277 consensus_queue.cc:1049] T 0bac0a6b89f34c549c5118605ed0acbf P 2c3fe57b9d2c424da181281af303f3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:27.445742 24786 tablet_service.cc:1495] Processing CreateTablet for tablet 2ee53da425f54c4aaed62a9211d5c2f9 (DEFAULT_TABLE table=default.table_5b01ae1724c5451c8ac9c936c5c8c983 [id=0bfc8c6dc2e94a92b142bee12f2b88e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:27.446209 24786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ee53da425f54c4aaed62a9211d5c2f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:27.453723 25224 tablet_bootstrap.cc:492] T 2ee53da425f54c4aaed62a9211d5c2f9 P 8668dad23e404dafb0ac25267f07bd46: Bootstrap starting.
I20261120 09:03:27.455952 25224 tablet_bootstrap.cc:654] T 2ee53da425f54c4aaed62a9211d5c2f9 P 8668dad23e404dafb0ac25267f07bd46: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:27.458702 24486 tablet_service.cc:1495] Processing CreateTablet for tablet 2ee53da425f54c4aaed62a9211d5c2f9 (DEFAULT_TABLE table=default.table_5b01ae1724c5451c8ac9c936c5c8c983 [id=0bfc8c6dc2e94a92b142bee12f2b88e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:27.459111 24486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ee53da425f54c4aaed62a9211d5c2f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20261120 09:03:27.465845 25217 tablet_bootstrap.cc:492] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2c3fe57b9d2c424da181281af303f3c3: Bootstrap starting.
I20261120 09:03:27.467659 25217 tablet_bootstrap.cc:654] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2c3fe57b9d2c424da181281af303f3c3: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:27.472481 25224 tablet_bootstrap.cc:492] T 2ee53da425f54c4aaed62a9211d5c2f9 P 8668dad23e404dafb0ac25267f07bd46: No bootstrap required, opened a new log
I20261120 09:03:27.472718 25277 consensus_queue.cc:1049] T 565df75f345947bea84b343c454ea1be P 2c3fe57b9d2c424da181281af303f3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20261120 09:03:27.473570 24445 consensus_peers.cc:597] T 565df75f345947bea84b343c454ea1be P 2c3fe57b9d2c424da181281af303f3c3 -> Peer 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): Couldn't send request to peer 2fb9ff0dc3d849d7bcf95806233d2c62. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20261120 09:03:27.474532 25224 ts_tablet_manager.cc:1449] T 2ee53da425f54c4aaed62a9211d5c2f9 P 8668dad23e404dafb0ac25267f07bd46: Time spent bootstrapping tablet: real 0.021s	user 0.003s	sys 0.000s
I20261120 09:03:27.475142 25217 tablet_bootstrap.cc:492] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2c3fe57b9d2c424da181281af303f3c3: No bootstrap required, opened a new log
I20261120 09:03:27.475258 25217 ts_tablet_manager.cc:1449] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2c3fe57b9d2c424da181281af303f3c3: Time spent bootstrapping tablet: real 0.010s	user 0.004s	sys 0.000s
I20261120 09:03:27.475970 25217 raft_consensus.cc:366] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.476106 25217 raft_consensus.cc:392] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:27.476197 25217 raft_consensus.cc:787] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Initialized, Role: FOLLOWER
I20261120 09:03:27.476413 25217 consensus_queue.cc:261] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2c3fe57b9d2c424da181281af303f3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.476894 25217 ts_tablet_manager.cc:1480] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2c3fe57b9d2c424da181281af303f3c3: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.000s
I20261120 09:03:27.477922 25224 raft_consensus.cc:366] T 2ee53da425f54c4aaed62a9211d5c2f9 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.478137 25224 raft_consensus.cc:392] T 2ee53da425f54c4aaed62a9211d5c2f9 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:27.478241 25224 raft_consensus.cc:787] T 2ee53da425f54c4aaed62a9211d5c2f9 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Initialized, Role: FOLLOWER
I20261120 09:03:27.478453 25224 consensus_queue.cc:261] T 2ee53da425f54c4aaed62a9211d5c2f9 P 8668dad23e404dafb0ac25267f07bd46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.479051 25224 ts_tablet_manager.cc:1480] T 2ee53da425f54c4aaed62a9211d5c2f9 P 8668dad23e404dafb0ac25267f07bd46: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.001s
I20261120 09:03:27.493983 24321 catalog_manager.cc:2228] deleted orphaned HMS catalog entry for table  [id=30da2006c3bb45c2b945f08d7cbe6945]
I20261120 09:03:27.494246 25072 catalog_manager.cc:2218] created HMS catalog entry for table  [id=86b210ad5a5d4f66ad1c8da6ec85dc53]
I20261120 09:03:27.494444 24321 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:41728 (request call id 31) took 3784 ms. Trace:
I20261120 09:03:27.494578 24321 rpcz_store.cc:276] 1120 09:03:23.710048 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:25.078409 (+1368361us) service_pool.cc:224] Handling call
1120 09:03:26.604997 (+1526588us) catalog_manager.cc:2145] Acquired catalog manager lock
1120 09:03:26.605566 (+   569us) catalog_manager.cc:2191] Created new table and tablet info
1120 09:03:27.134711 (+529145us) catalog_manager.cc:2217] Created new table in HMS catalog
1120 09:03:27.135563 (+   852us) write_op.cc:494] Releasing partition, row and schema locks
1120 09:03:27.135567 (+     4us) write_op.cc:459] Released schema lock
1120 09:03:27.135789 (+   222us) catalog_manager.cc:2225] Rolling back HMS table creation
1120 09:03:27.494392 (+358603us) inbound_call.cc:177] Queueing success response
Related trace 'op':
1120 09:03:27.135481 (+     0us) op_driver.cc:391] HandleFailure(Illegal state: replica d82bf27d60fa450e8f941d1a9d36a825 is not leader of this config: current role FOLLOWER)
1120 09:03:27.135502 (+    21us) write_op.cc:494] Releasing partition, row and schema locks
1120 09:03:27.135510 (+     8us) write_op.cc:459] Released schema lock
1120 09:03:27.135515 (+     5us) write_op.cc:340] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":561634,"Hive Metastore.run_cpu_time_us":498,"Hive Metastore.run_wall_time_us":324979,"child_traces":[["op",{}]]}
I20261120 09:03:27.548739 25077 catalog_manager.cc:3588] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59800:
table { table_name: "default.Table_67a0134c1cdf49a49bea9d4b2818b558" } new_table_name: "default.Table_eceda3a9ee26453fa14f5588cd5b09e1" modify_external_catalogs: true
I20261120 09:03:27.564162 25078 catalog_manager.cc:2218] created HMS catalog entry for table  [id=1513ff7b0a7c4bcb9127e67296a844c5]
I20261120 09:03:27.570327 25234 tablet_bootstrap.cc:492] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62: No bootstrap required, opened a new log
I20261120 09:03:27.570544 25234 ts_tablet_manager.cc:1449] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent bootstrapping tablet: real 0.357s	user 0.026s	sys 0.094s
I20261120 09:03:27.571748 25234 raft_consensus.cc:366] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.571956 25234 raft_consensus.cc:392] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:27.572053 25234 raft_consensus.cc:787] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Initialized, Role: FOLLOWER
I20261120 09:03:27.572278 25234 consensus_queue.cc:261] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.573025 25234 ts_tablet_manager.cc:1480] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.002s
I20261120 09:03:27.573320 25234 tablet_bootstrap.cc:492] T 212960af80bf45deb7c508c3356d3391 P 2fb9ff0dc3d849d7bcf95806233d2c62: Bootstrap starting.
I20261120 09:03:27.574800 25072 catalog_manager.cc:5856] T 0bac0a6b89f34c549c5118605ed0acbf P 8668dad23e404dafb0ac25267f07bd46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65). New cstate: current_term: 1 leader_uuid: "2c3fe57b9d2c424da181281af303f3c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } } }
I20261120 09:03:27.575493 25234 tablet_bootstrap.cc:654] T 212960af80bf45deb7c508c3356d3391 P 2fb9ff0dc3d849d7bcf95806233d2c62: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:27.575315 25072 catalog_manager.cc:5856] T 18019fa55aae42be8fb9e5421dd45630 P 8668dad23e404dafb0ac25267f07bd46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67). New cstate: current_term: 1 leader_uuid: "8668dad23e404dafb0ac25267f07bd46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } health_report { overall_health: HEALTHY } } }
I20261120 09:03:27.575822 25072 catalog_manager.cc:5956] TS 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035) does not have the latest schema for tablet 18019fa55aae42be8fb9e5421dd45630 (table default.table_0d4b09a9b1754e38bca62e97c14a0854 [id=83bafe99e25046a4a43a3739a3ca07a1]). Expected version 1 got 0
I20261120 09:03:27.579296 24786 tablet_service.cc:1495] Processing CreateTablet for tablet 5276bce755e042379220edc02e7b8f09 (DEFAULT_TABLE table=default.table_6a2be3a544144a99b0f343bca3024912 [id=35553b36397740a29f2588fd2a840c61]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:27.579733 24786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5276bce755e042379220edc02e7b8f09. 1 dirs total, 0 dirs full, 0 dirs failed
W20261120 09:03:27.580233 24744 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.79.66:38879, user_credentials={real_user=slave}} blocked reactor thread for 92234.6us
I20261120 09:03:27.585464 24486 tablet_service.cc:1495] Processing CreateTablet for tablet 5276bce755e042379220edc02e7b8f09 (DEFAULT_TABLE table=default.table_6a2be3a544144a99b0f343bca3024912 [id=35553b36397740a29f2588fd2a840c61]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:27.585916 24486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5276bce755e042379220edc02e7b8f09. 1 dirs total, 0 dirs full, 0 dirs failed
F20261120 09:03:27.592760 25160 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 26, previous 26; dumping first 6 out of 14 received events: NotificationEvent(eventId=22, eventTime=1795165406, eventType=CREATE_TABLE, dbName=default, tableName=table_c622167e221c4db9953d7a278bd41411, message={"server":"","servicePrincipal":"","db":"default","table":"table_c622167e221c4db9953d7a278bd41411","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_c622167e221c4db9953d7a278bd41411\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1795165406},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/warehouse/table_c622167e221c4db9953d7a278bd41411\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_c622167e221c4db9953d7a278bd41411\",\"kudu.table_id\":\"b21dc844213f4fc8b0f28c935f221a1b\",\"transient_lastDdlTime\":\"1795165406\",\"comment\":\"\",\"kudu.master_addresses\":\"127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"b96ccaeeefb845f4962e35569b62531b\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1795165406,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1795165406, eventType=DROP_TABLE, dbName=default, tableName=table_d68821f474e040e18b4d91fbbd850863, message={"server":"","servicePrincipal":"","db":"default","table":"table_d68821f474e040e18b4d91fbbd850863","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_d68821f474e040e18b4d91fbbd850863\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1795165403},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/warehouse/table_d68821f474e040e18b4d91fbbd850863\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_d68821f474e040e18b4d91fbbd850863\",\"kudu.table_id\":\"9d133f08f71d42b89628f2869cbaa424\",\"transient_lastDdlTime\":\"1795165403\",\"comment\":\"\",\"kudu.master_addresses\":\"127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"b96ccaeeefb845f4962e35569b62531b\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1795165406}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=24, eventTime=1795165407, eventType=ALTER_TABLE, dbName=default, tableName=table_a63a3233f7d94bf99010f9b0c7cb365e, message={"server":"","servicePrincipal":"","db":"default","table":"table_39131cc9c462405ba3639c841ebfe256","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_39131cc9c462405ba3639c841ebfe256\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1795165402},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/warehouse/table_39131cc9c462405ba3639c841ebfe256\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_39131cc9c462405ba3639c841ebfe256\",\"kudu.table_id\":\"cb55967ea90e43be8da1354763f7984c\",\"transient_lastDdlTime\":\"1795165402\",\"comment\":\"\",\"kudu.master_addresses\":\"127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"b96ccaeeefb845f4962e35569b62531b\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_a63a3233f7d94bf99010f9b0c7cb365e\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1795165402},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/warehouse/table_a63a3233f7d94bf99010f9b0c7cb365e\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a63a3233f7d94bf99010f9b0c7cb365e\",\"kudu.table_id\":\"cb55967ea90e43be8da1354763f7984c\",\"transient_lastDdlTime\":\"1795165402\",\"comment\":\"\",\"kudu.master_addresses\":\"127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"b96ccaeeefb845f4962e35569b62531b\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1795165407}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=25, eventTime=1795165407, eventType=DROP_TABLE, dbName=default, tableName=table_d67fc59080cc4194b566604a649aefad, message={"server":"","servicePrincipal":"","db":"default","table":"table_d67fc59080cc4194b566604a649aefad","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_d67fc59080cc4194b566604a649aefad\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1795165403},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/warehouse/table_d67fc59080cc4194b566604a649aefad\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_d67fc59080cc4194b566604a649aefad\",\"kudu.table_id\":\"ec464d0cd5ec4ec2bc03ebb8a14481e0\",\"transient_lastDdlTime\":\"1795165403\",\"comment\":\"\",\"kudu.master_addresses\":\"127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"b96ccaeeefb845f4962e35569b62531b\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1795165407}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=26, eventTime=1795165407, eventType=CREATE_TABLE, dbName=default, tableName=table_414553f5c3994f4097d7fdbf9dc01082, message={"server":"","servicePrincipal":"","db":"default","table":"table_414553f5c3994f4097d7fdbf9dc01082","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_414553f5c3994f4097d7fdbf9dc01082\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1795165407},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/warehouse/table_414553f5c3994f4097d7fdbf9dc01082\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_414553f5c3994f4097d7fdbf9dc01082\",\"kudu.table_id\":\"55152bf51e49475ea6391839e6630cd0\",\"transient_lastDdlTime\":\"1795165407\",\"comment\":\"\",\"kudu.master_addresses\":\"127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"b96ccaeeefb845f4962e35569b62531b\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1795165407,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=26, eventTime=1795165407, eventType=CREATE_TABLE, dbName=default, tableName=table_ebc744ebb12d4dd498ca3721c3b9ac6a, message={"server":"","servicePrincipal":"","db":"default","table":"table_ebc744ebb12d4dd498ca3721c3b9ac6a","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_ebc744ebb12d4dd498ca3721c3b9ac6a\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1795165407},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/warehouse/table_ebc744ebb12d4dd498ca3721c3b9ac6a\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_ebc744ebb12d4dd498ca3721c3b9ac6a\",\"kudu.table_id\":\"30da2006c3bb45c2b945f08d7cbe6945\",\"transient_lastDdlTime\":\"1795165407\",\"comment\":\"\",\"kudu.master_addresses\":\"127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"b96ccaeeefb845f4962e35569b62531b\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1795165407,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
    @     0x7f90614b9d5d  google::LogMessage::Fail() at ??:0
I20261120 09:03:27.597080 25224 tablet_bootstrap.cc:492] T 5276bce755e042379220edc02e7b8f09 P 8668dad23e404dafb0ac25267f07bd46: Bootstrap starting.
I20261120 09:03:27.597010 24641 tablet_service.cc:1495] Processing CreateTablet for tablet 5276bce755e042379220edc02e7b8f09 (DEFAULT_TABLE table=default.table_6a2be3a544144a99b0f343bca3024912 [id=35553b36397740a29f2588fd2a840c61]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:27.597424 24641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5276bce755e042379220edc02e7b8f09. 1 dirs total, 0 dirs full, 0 dirs failed
    @     0x7f90614bdb23  google::LogMessage::SendToLog() at ??:0
I20261120 09:03:27.598932 25224 tablet_bootstrap.cc:654] T 5276bce755e042379220edc02e7b8f09 P 8668dad23e404dafb0ac25267f07bd46: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:27.604840 24315 catalog_manager.cc:2228] deleted orphaned HMS catalog entry for table  [id=7509b508c8334915b8f08e6922eb5f81]
    @     0x7f90614b975c  google::LogMessage::Flush() at ??:0
I20261120 09:03:27.605170 24315 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:41728 (request call id 34) took 3735 ms. Trace:
I20261120 09:03:27.605260 24315 rpcz_store.cc:276] 1120 09:03:23.869351 (+     0us) service_pool.cc:167] Inserting onto call queue
1120 09:03:25.845285 (+1975934us) service_pool.cc:224] Handling call
1120 09:03:26.607497 (+762212us) catalog_manager.cc:2145] Acquired catalog manager lock
1120 09:03:26.608008 (+   511us) catalog_manager.cc:2191] Created new table and tablet info
1120 09:03:27.234853 (+626845us) catalog_manager.cc:2217] Created new table in HMS catalog
1120 09:03:27.235554 (+   701us) write_op.cc:494] Releasing partition, row and schema locks
1120 09:03:27.235558 (+     4us) write_op.cc:459] Released schema lock
1120 09:03:27.235746 (+   188us) catalog_manager.cc:2225] Rolling back HMS table creation
1120 09:03:27.605126 (+369380us) inbound_call.cc:177] Queueing success response
Related trace 'op':
1120 09:03:27.235472 (+     0us) op_driver.cc:391] HandleFailure(Illegal state: replica d82bf27d60fa450e8f941d1a9d36a825 is not leader of this config: current role FOLLOWER)
1120 09:03:27.235484 (+    12us) write_op.cc:494] Releasing partition, row and schema locks
1120 09:03:27.235510 (+    26us) write_op.cc:459] Released schema lock
1120 09:03:27.235515 (+     5us) write_op.cc:340] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":784231,"Hive Metastore.run_cpu_time_us":460,"Hive Metastore.run_wall_time_us":210562,"child_traces":[["op",{}]]}
W20261120 09:03:27.606139 24861 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.23.79.126:41659)
    @     0x7f90614b99a1  google::LogMessage::~LogMessage() at ??:0
I20261120 09:03:27.607786 25072 catalog_manager.cc:2551] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59800:
table { table_name: "default.Table_b329d3b2bb9a409b9290011073304555" } modify_external_catalogs: true
I20261120 09:03:27.608072 25072 catalog_manager.cc:2799] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59800:
table { table_name: "default.Table_b329d3b2bb9a409b9290011073304555" } modify_external_catalogs: true
I20261120 09:03:27.609872 25217 tablet_bootstrap.cc:492] T 5276bce755e042379220edc02e7b8f09 P 2c3fe57b9d2c424da181281af303f3c3: Bootstrap starting.
I20261120 09:03:27.613269 25217 tablet_bootstrap.cc:654] T 5276bce755e042379220edc02e7b8f09 P 2c3fe57b9d2c424da181281af303f3c3: Neither blocks nor log segments found. Creating new log.
    @     0x7f90769893f4  kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20261120 09:03:27.615468 25234 tablet_bootstrap.cc:492] T 212960af80bf45deb7c508c3356d3391 P 2fb9ff0dc3d849d7bcf95806233d2c62: No bootstrap required, opened a new log
I20261120 09:03:27.615672 25234 ts_tablet_manager.cc:1449] T 212960af80bf45deb7c508c3356d3391 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.003s
I20261120 09:03:27.616333 25234 raft_consensus.cc:366] T 212960af80bf45deb7c508c3356d3391 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.616488 25234 raft_consensus.cc:392] T 212960af80bf45deb7c508c3356d3391 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:27.616535 25234 raft_consensus.cc:787] T 212960af80bf45deb7c508c3356d3391 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Initialized, Role: FOLLOWER
I20261120 09:03:27.616772 25234 consensus_queue.cc:261] T 212960af80bf45deb7c508c3356d3391 P 2fb9ff0dc3d849d7bcf95806233d2c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.617240 25234 ts_tablet_manager.cc:1480] T 212960af80bf45deb7c508c3356d3391 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20261120 09:03:27.618287 25234 tablet_bootstrap.cc:492] T 0bac0a6b89f34c549c5118605ed0acbf P 2fb9ff0dc3d849d7bcf95806233d2c62: Bootstrap starting.
I20261120 09:03:27.620010 25234 tablet_bootstrap.cc:654] T 0bac0a6b89f34c549c5118605ed0acbf P 2fb9ff0dc3d849d7bcf95806233d2c62: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:27.623984 25078 catalog_manager.cc:5956] TS 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879) does not have the latest schema for tablet 18019fa55aae42be8fb9e5421dd45630 (table default.table_0d4b09a9b1754e38bca62e97c14a0854 [id=83bafe99e25046a4a43a3739a3ca07a1]). Expected version 1 got 0
I20261120 09:03:27.627408 24641 tablet_service.cc:1495] Processing CreateTablet for tablet 32a60fc620aa4027b4653877225c0604 (DEFAULT_TABLE table=default.table_5f2e35d59fff4bc89139835f148d0414 [id=86b210ad5a5d4f66ad1c8da6ec85dc53]), partition=RANGE (key) PARTITION UNBOUNDED
    @     0x7f9076987ca1  kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20261120 09:03:27.627926 24641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32a60fc620aa4027b4653877225c0604. 1 dirs total, 0 dirs full, 0 dirs failed
    @     0x7f907698f91c  kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20261120 09:03:27.633559 24486 tablet_service.cc:1495] Processing CreateTablet for tablet 32a60fc620aa4027b4653877225c0604 (DEFAULT_TABLE table=default.table_5f2e35d59fff4bc89139835f148d0414 [id=86b210ad5a5d4f66ad1c8da6ec85dc53]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:27.634019 24486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32a60fc620aa4027b4653877225c0604. 1 dirs total, 0 dirs full, 0 dirs failed
    @     0x7f907698f799  std::_Function_handler<>::_M_invoke() at ??:0
    @           0x372c7d  std::function<>::operator()() at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/../sanitizer_common/sanitizer_common_interceptors.inc:5196
I20261120 09:03:27.638744 24786 tablet_service.cc:1495] Processing CreateTablet for tablet 32a60fc620aa4027b4653877225c0604 (DEFAULT_TABLE table=default.table_5f2e35d59fff4bc89139835f148d0414 [id=86b210ad5a5d4f66ad1c8da6ec85dc53]), partition=RANGE (key) PARTITION UNBOUNDED
I20261120 09:03:27.639148 24786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32a60fc620aa4027b4653877225c0604. 1 dirs total, 0 dirs full, 0 dirs failed
    @     0x7f9062903dd9  kudu::Thread::SuperviseThread() at ??:0
    @     0x7f9065fec6db  start_thread at ??:0
    @     0x7f905ea4d61f  clone at ??:0
I20261120 09:03:27.656044 25217 tablet_bootstrap.cc:492] T 5276bce755e042379220edc02e7b8f09 P 2c3fe57b9d2c424da181281af303f3c3: No bootstrap required, opened a new log
I20261120 09:03:27.656270 25217 ts_tablet_manager.cc:1449] T 5276bce755e042379220edc02e7b8f09 P 2c3fe57b9d2c424da181281af303f3c3: Time spent bootstrapping tablet: real 0.046s	user 0.004s	sys 0.004s
I20261120 09:03:27.657074 25217 raft_consensus.cc:366] T 5276bce755e042379220edc02e7b8f09 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.657277 25217 raft_consensus.cc:392] T 5276bce755e042379220edc02e7b8f09 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:27.657326 25224 tablet_bootstrap.cc:492] T 5276bce755e042379220edc02e7b8f09 P 8668dad23e404dafb0ac25267f07bd46: No bootstrap required, opened a new log
I20261120 09:03:27.657353 25217 raft_consensus.cc:787] T 5276bce755e042379220edc02e7b8f09 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Initialized, Role: FOLLOWER
I20261120 09:03:27.657490 25224 ts_tablet_manager.cc:1449] T 5276bce755e042379220edc02e7b8f09 P 8668dad23e404dafb0ac25267f07bd46: Time spent bootstrapping tablet: real 0.060s	user 0.014s	sys 0.014s
I20261120 09:03:27.657617 25217 consensus_queue.cc:261] T 5276bce755e042379220edc02e7b8f09 P 2c3fe57b9d2c424da181281af303f3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.658151 25217 ts_tablet_manager.cc:1480] T 5276bce755e042379220edc02e7b8f09 P 2c3fe57b9d2c424da181281af303f3c3: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.000s
I20261120 09:03:27.658232 25224 raft_consensus.cc:366] T 5276bce755e042379220edc02e7b8f09 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.658437 25224 raft_consensus.cc:392] T 5276bce755e042379220edc02e7b8f09 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:27.658543 25224 raft_consensus.cc:787] T 5276bce755e042379220edc02e7b8f09 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Initialized, Role: FOLLOWER
I20261120 09:03:27.659318 25217 tablet_bootstrap.cc:492] T 32a60fc620aa4027b4653877225c0604 P 2c3fe57b9d2c424da181281af303f3c3: Bootstrap starting.
I20261120 09:03:27.659349 25234 tablet_bootstrap.cc:492] T 0bac0a6b89f34c549c5118605ed0acbf P 2fb9ff0dc3d849d7bcf95806233d2c62: No bootstrap required, opened a new log
I20261120 09:03:27.659485 25234 ts_tablet_manager.cc:1449] T 0bac0a6b89f34c549c5118605ed0acbf P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent bootstrapping tablet: real 0.041s	user 0.003s	sys 0.025s
I20261120 09:03:27.660236 25234 raft_consensus.cc:366] T 0bac0a6b89f34c549c5118605ed0acbf P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.660470 25234 raft_consensus.cc:392] T 0bac0a6b89f34c549c5118605ed0acbf P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:27.660565 25234 raft_consensus.cc:787] T 0bac0a6b89f34c549c5118605ed0acbf P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Initialized, Role: FOLLOWER
I20261120 09:03:27.660858 25234 consensus_queue.cc:261] T 0bac0a6b89f34c549c5118605ed0acbf P 2fb9ff0dc3d849d7bcf95806233d2c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.661463 25224 consensus_queue.cc:261] T 5276bce755e042379220edc02e7b8f09 P 8668dad23e404dafb0ac25267f07bd46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.662040 25224 ts_tablet_manager.cc:1480] T 5276bce755e042379220edc02e7b8f09 P 8668dad23e404dafb0ac25267f07bd46: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
I20261120 09:03:27.663911 25224 tablet_bootstrap.cc:492] T 32a60fc620aa4027b4653877225c0604 P 8668dad23e404dafb0ac25267f07bd46: Bootstrap starting.
I20261120 09:03:27.665210 25217 tablet_bootstrap.cc:654] T 32a60fc620aa4027b4653877225c0604 P 2c3fe57b9d2c424da181281af303f3c3: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:27.667870 25224 tablet_bootstrap.cc:654] T 32a60fc620aa4027b4653877225c0604 P 8668dad23e404dafb0ac25267f07bd46: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:27.670696 25224 tablet_bootstrap.cc:492] T 32a60fc620aa4027b4653877225c0604 P 8668dad23e404dafb0ac25267f07bd46: No bootstrap required, opened a new log
I20261120 09:03:27.670846 25224 ts_tablet_manager.cc:1449] T 32a60fc620aa4027b4653877225c0604 P 8668dad23e404dafb0ac25267f07bd46: Time spent bootstrapping tablet: real 0.007s	user 0.002s	sys 0.001s
I20261120 09:03:27.672075 25224 raft_consensus.cc:366] T 32a60fc620aa4027b4653877225c0604 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.674477 25224 raft_consensus.cc:392] T 32a60fc620aa4027b4653877225c0604 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:27.674913 25224 raft_consensus.cc:787] T 32a60fc620aa4027b4653877225c0604 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Initialized, Role: FOLLOWER
I20261120 09:03:27.675246 25224 consensus_queue.cc:261] T 32a60fc620aa4027b4653877225c0604 P 8668dad23e404dafb0ac25267f07bd46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.675880 25224 ts_tablet_manager.cc:1480] T 32a60fc620aa4027b4653877225c0604 P 8668dad23e404dafb0ac25267f07bd46: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.001s
I20261120 09:03:27.677116 25217 tablet_bootstrap.cc:492] T 32a60fc620aa4027b4653877225c0604 P 2c3fe57b9d2c424da181281af303f3c3: No bootstrap required, opened a new log
I20261120 09:03:27.677282 25217 ts_tablet_manager.cc:1449] T 32a60fc620aa4027b4653877225c0604 P 2c3fe57b9d2c424da181281af303f3c3: Time spent bootstrapping tablet: real 0.018s	user 0.003s	sys 0.003s
I20261120 09:03:27.678192 25217 raft_consensus.cc:366] T 32a60fc620aa4027b4653877225c0604 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.678436 25217 raft_consensus.cc:392] T 32a60fc620aa4027b4653877225c0604 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:27.678598 25217 raft_consensus.cc:787] T 32a60fc620aa4027b4653877225c0604 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3fe57b9d2c424da181281af303f3c3, State: Initialized, Role: FOLLOWER
I20261120 09:03:27.678893 25217 consensus_queue.cc:261] T 32a60fc620aa4027b4653877225c0604 P 2c3fe57b9d2c424da181281af303f3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.679693 25217 ts_tablet_manager.cc:1480] T 32a60fc620aa4027b4653877225c0604 P 2c3fe57b9d2c424da181281af303f3c3: Time spent starting tablet: real 0.002s	user 0.003s	sys 0.000s
I20261120 09:03:27.680611 25179 raft_consensus.cc:534] T 26f97270103e4956b82be66244c71301 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:27.680743 25179 raft_consensus.cc:556] T 26f97270103e4956b82be66244c71301 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.681396 25179 leader_election.cc:290] T 26f97270103e4956b82be66244c71301 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:27.682102 24660 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "26f97270103e4956b82be66244c71301" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" is_pre_election: true
I20261120 09:03:27.682369 24660 raft_consensus.cc:2062] T 26f97270103e4956b82be66244c71301 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 8668dad23e404dafb0ac25267f07bd46 in term 0
I20261120 09:03:27.682868 24744 leader_election.cc:304] T 26f97270103e4956b82be66244c71301 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62, 8668dad23e404dafb0ac25267f07bd46; no voters: 
I20261120 09:03:27.683578 24508 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "26f97270103e4956b82be66244c71301" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3" is_pre_election: true
I20261120 09:03:27.683820 24508 raft_consensus.cc:2062] T 26f97270103e4956b82be66244c71301 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 8668dad23e404dafb0ac25267f07bd46 in term 0
I20261120 09:03:27.684454 25179 raft_consensus.cc:3024] T 26f97270103e4956b82be66244c71301 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261120 09:03:27.684578 25179 raft_consensus.cc:534] T 26f97270103e4956b82be66244c71301 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261120 09:03:27.684667 25179 raft_consensus.cc:3296] T 26f97270103e4956b82be66244c71301 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:27.685027 25179 raft_consensus.cc:556] T 26f97270103e4956b82be66244c71301 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.691092 25179 leader_election.cc:290] T 26f97270103e4956b82be66244c71301 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 election: Requested vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:27.692099 24660 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "26f97270103e4956b82be66244c71301" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62"
I20261120 09:03:27.692349 24660 raft_consensus.cc:3296] T 26f97270103e4956b82be66244c71301 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:27.692728 24660 raft_consensus.cc:2062] T 26f97270103e4956b82be66244c71301 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 8668dad23e404dafb0ac25267f07bd46 in term 1
I20261120 09:03:27.693336 24508 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "26f97270103e4956b82be66244c71301" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3"
I20261120 09:03:27.693552 24508 raft_consensus.cc:3296] T 26f97270103e4956b82be66244c71301 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:27.693890 24508 raft_consensus.cc:2062] T 26f97270103e4956b82be66244c71301 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 8668dad23e404dafb0ac25267f07bd46 in term 1
I20261120 09:03:27.697233 24744 leader_election.cc:304] T 26f97270103e4956b82be66244c71301 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62, 8668dad23e404dafb0ac25267f07bd46; no voters: 
I20261120 09:03:27.700809 25179 raft_consensus.cc:3024] T 26f97270103e4956b82be66244c71301 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Leader election won for term 1
I20261120 09:03:27.700984 25179 raft_consensus.cc:744] T 26f97270103e4956b82be66244c71301 P 8668dad23e404dafb0ac25267f07bd46 [term 1 LEADER]: Becoming Leader. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Running, Role: LEADER
I20261120 09:03:27.701442 25179 consensus_queue.cc:238] T 26f97270103e4956b82be66244c71301 P 8668dad23e404dafb0ac25267f07bd46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.703523 25284 raft_consensus.cc:534] T 32a60fc620aa4027b4653877225c0604 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:27.703663 25284 raft_consensus.cc:556] T 32a60fc620aa4027b4653877225c0604 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.704355 25284 leader_election.cc:290] T 32a60fc620aa4027b4653877225c0604 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:27.706439 24660 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "32a60fc620aa4027b4653877225c0604" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" is_pre_election: true
I20261120 09:03:27.706825 25234 ts_tablet_manager.cc:1480] T 0bac0a6b89f34c549c5118605ed0acbf P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent starting tablet: real 0.047s	user 0.019s	sys 0.015s
I20261120 09:03:27.707249 25234 tablet_bootstrap.cc:492] T 565df75f345947bea84b343c454ea1be P 2fb9ff0dc3d849d7bcf95806233d2c62: Bootstrap starting.
I20261120 09:03:27.708809 24508 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "32a60fc620aa4027b4653877225c0604" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3" is_pre_election: true
I20261120 09:03:27.709018 24508 raft_consensus.cc:2062] T 32a60fc620aa4027b4653877225c0604 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 8668dad23e404dafb0ac25267f07bd46 in term 0
W20261120 09:03:27.709854 24744 leader_election.cc:343] T 32a60fc620aa4027b4653877225c0604 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): Illegal state: must be running to vote when last-logged opid is not known
I20261120 09:03:27.710078 24742 leader_election.cc:304] T 32a60fc620aa4027b4653877225c0604 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46; no voters: 2fb9ff0dc3d849d7bcf95806233d2c62
I20261120 09:03:27.710749 25284 raft_consensus.cc:3024] T 32a60fc620aa4027b4653877225c0604 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261120 09:03:27.710866 25284 raft_consensus.cc:534] T 32a60fc620aa4027b4653877225c0604 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261120 09:03:27.710948 25284 raft_consensus.cc:3296] T 32a60fc620aa4027b4653877225c0604 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:27.713915 25234 tablet_bootstrap.cc:654] T 565df75f345947bea84b343c454ea1be P 2fb9ff0dc3d849d7bcf95806233d2c62: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:27.715461 25262 raft_consensus.cc:534] T 5276bce755e042379220edc02e7b8f09 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:27.715580 25262 raft_consensus.cc:556] T 5276bce755e042379220edc02e7b8f09 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.716166 25262 leader_election.cc:290] T 5276bce755e042379220edc02e7b8f09 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:27.716928 24508 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "5276bce755e042379220edc02e7b8f09" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3" is_pre_election: true
I20261120 09:03:27.717124 24508 raft_consensus.cc:2062] T 5276bce755e042379220edc02e7b8f09 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 8668dad23e404dafb0ac25267f07bd46 in term 0
I20261120 09:03:27.717795 24660 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "5276bce755e042379220edc02e7b8f09" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" is_pre_election: true
I20261120 09:03:27.717971 24742 leader_election.cc:304] T 5276bce755e042379220edc02e7b8f09 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46; no voters: 
W20261120 09:03:27.718257 24744 leader_election.cc:343] T 5276bce755e042379220edc02e7b8f09 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): Illegal state: must be running to vote when last-logged opid is not known
I20261120 09:03:27.718308 25262 raft_consensus.cc:3024] T 5276bce755e042379220edc02e7b8f09 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261120 09:03:27.718431 25262 raft_consensus.cc:534] T 5276bce755e042379220edc02e7b8f09 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261120 09:03:27.718561 25262 raft_consensus.cc:3296] T 5276bce755e042379220edc02e7b8f09 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:27.718855 25262 raft_consensus.cc:556] T 5276bce755e042379220edc02e7b8f09 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.719077 25234 tablet_bootstrap.cc:492] T 565df75f345947bea84b343c454ea1be P 2fb9ff0dc3d849d7bcf95806233d2c62: No bootstrap required, opened a new log
I20261120 09:03:27.719213 25234 ts_tablet_manager.cc:1449] T 565df75f345947bea84b343c454ea1be P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.000s
I20261120 09:03:27.719859 25234 raft_consensus.cc:366] T 565df75f345947bea84b343c454ea1be P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.720023 25234 raft_consensus.cc:392] T 565df75f345947bea84b343c454ea1be P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:27.720083 25234 raft_consensus.cc:787] T 565df75f345947bea84b343c454ea1be P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Initialized, Role: FOLLOWER
I20261120 09:03:27.720360 25234 consensus_queue.cc:261] T 565df75f345947bea84b343c454ea1be P 2fb9ff0dc3d849d7bcf95806233d2c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.722095 25234 ts_tablet_manager.cc:1480] T 565df75f345947bea84b343c454ea1be P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent starting tablet: real 0.003s	user 0.002s	sys 0.000s
I20261120 09:03:27.722335 25234 tablet_bootstrap.cc:492] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2fb9ff0dc3d849d7bcf95806233d2c62: Bootstrap starting.
I20261120 09:03:27.722280 25284 raft_consensus.cc:556] T 32a60fc620aa4027b4653877225c0604 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.722941 25284 leader_election.cc:290] T 32a60fc620aa4027b4653877225c0604 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 election: Requested vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:27.723632 24660 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "32a60fc620aa4027b4653877225c0604" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62"
I20261120 09:03:27.724550 24508 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "32a60fc620aa4027b4653877225c0604" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3"
I20261120 09:03:27.724773 24508 raft_consensus.cc:3296] T 32a60fc620aa4027b4653877225c0604 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:27.725140 24508 raft_consensus.cc:2062] T 32a60fc620aa4027b4653877225c0604 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 8668dad23e404dafb0ac25267f07bd46 in term 1
I20261120 09:03:27.725165 25234 tablet_bootstrap.cc:654] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2fb9ff0dc3d849d7bcf95806233d2c62: Neither blocks nor log segments found. Creating new log.
W20261120 09:03:27.726765 24744 leader_election.cc:343] T 32a60fc620aa4027b4653877225c0604 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): Illegal state: must be running to vote when last-logged opid is not known
I20261120 09:03:27.729084 24742 leader_election.cc:304] T 32a60fc620aa4027b4653877225c0604 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46; no voters: 2fb9ff0dc3d849d7bcf95806233d2c62
I20261120 09:03:27.733640 25284 raft_consensus.cc:3024] T 32a60fc620aa4027b4653877225c0604 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Leader election won for term 1
I20261120 09:03:27.737601 25262 leader_election.cc:290] T 5276bce755e042379220edc02e7b8f09 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 election: Requested vote from peers 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:27.739307 24660 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "5276bce755e042379220edc02e7b8f09" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62"
W20261120 09:03:27.739882 24744 leader_election.cc:343] T 5276bce755e042379220edc02e7b8f09 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): Illegal state: must be running to vote when last-logged opid is not known
I20261120 09:03:27.740543 24508 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "5276bce755e042379220edc02e7b8f09" candidate_uuid: "8668dad23e404dafb0ac25267f07bd46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3"
I20261120 09:03:27.740790 24508 raft_consensus.cc:3296] T 5276bce755e042379220edc02e7b8f09 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:27.741210 24508 raft_consensus.cc:2062] T 5276bce755e042379220edc02e7b8f09 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 8668dad23e404dafb0ac25267f07bd46 in term 1
I20261120 09:03:27.741935 25306 consensus_queue.cc:1049] T 26f97270103e4956b82be66244c71301 P 8668dad23e404dafb0ac25267f07bd46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:27.746840 25305 consensus_queue.cc:1049] T 26f97270103e4956b82be66244c71301 P 8668dad23e404dafb0ac25267f07bd46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:27.758042 25284 raft_consensus.cc:744] T 32a60fc620aa4027b4653877225c0604 P 8668dad23e404dafb0ac25267f07bd46 [term 1 LEADER]: Becoming Leader. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Running, Role: LEADER
I20261120 09:03:27.758361 24742 leader_election.cc:304] T 5276bce755e042379220edc02e7b8f09 P 8668dad23e404dafb0ac25267f07bd46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46; no voters: 2fb9ff0dc3d849d7bcf95806233d2c62
I20261120 09:03:27.758450 25284 consensus_queue.cc:238] T 32a60fc620aa4027b4653877225c0604 P 8668dad23e404dafb0ac25267f07bd46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.759068 25233 raft_consensus.cc:3024] T 5276bce755e042379220edc02e7b8f09 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Leader election won for term 1
I20261120 09:03:27.759306 25233 raft_consensus.cc:744] T 5276bce755e042379220edc02e7b8f09 P 8668dad23e404dafb0ac25267f07bd46 [term 1 LEADER]: Becoming Leader. State: Replica: 8668dad23e404dafb0ac25267f07bd46, State: Running, Role: LEADER
I20261120 09:03:27.759644 25233 consensus_queue.cc:238] T 5276bce755e042379220edc02e7b8f09 P 8668dad23e404dafb0ac25267f07bd46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
W20261120 09:03:27.763537 24744 consensus_peers.cc:597] T 5276bce755e042379220edc02e7b8f09 P 8668dad23e404dafb0ac25267f07bd46 -> Peer 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): Couldn't send request to peer 2fb9ff0dc3d849d7bcf95806233d2c62. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20261120 09:03:27.773710 25305 consensus_queue.cc:1049] T 5276bce755e042379220edc02e7b8f09 P 8668dad23e404dafb0ac25267f07bd46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:27.779182 25234 tablet_bootstrap.cc:492] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2fb9ff0dc3d849d7bcf95806233d2c62: No bootstrap required, opened a new log
I20261120 09:03:27.779336 25234 ts_tablet_manager.cc:1449] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent bootstrapping tablet: real 0.057s	user 0.027s	sys 0.021s
I20261120 09:03:27.780189 25234 raft_consensus.cc:366] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.780351 25234 raft_consensus.cc:392] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:27.780432 25234 raft_consensus.cc:787] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Initialized, Role: FOLLOWER
I20261120 09:03:27.780655 25234 consensus_queue.cc:261] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2fb9ff0dc3d849d7bcf95806233d2c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.782213 25234 ts_tablet_manager.cc:1480] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent starting tablet: real 0.003s	user 0.000s	sys 0.002s
I20261120 09:03:27.782475 25234 tablet_bootstrap.cc:492] T 5276bce755e042379220edc02e7b8f09 P 2fb9ff0dc3d849d7bcf95806233d2c62: Bootstrap starting.
I20261120 09:03:27.785284 25234 tablet_bootstrap.cc:654] T 5276bce755e042379220edc02e7b8f09 P 2fb9ff0dc3d849d7bcf95806233d2c62: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:27.790560 25284 consensus_queue.cc:1049] T 32a60fc620aa4027b4653877225c0604 P 8668dad23e404dafb0ac25267f07bd46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20261120 09:03:27.794467 24744 consensus_peers.cc:597] T 32a60fc620aa4027b4653877225c0604 P 8668dad23e404dafb0ac25267f07bd46 -> Peer 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879): Couldn't send request to peer 2fb9ff0dc3d849d7bcf95806233d2c62. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20261120 09:03:27.824990 25234 tablet_bootstrap.cc:492] T 5276bce755e042379220edc02e7b8f09 P 2fb9ff0dc3d849d7bcf95806233d2c62: No bootstrap required, opened a new log
I20261120 09:03:27.825169 25234 ts_tablet_manager.cc:1449] T 5276bce755e042379220edc02e7b8f09 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent bootstrapping tablet: real 0.043s	user 0.004s	sys 0.029s
I20261120 09:03:27.825947 25234 raft_consensus.cc:366] T 5276bce755e042379220edc02e7b8f09 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.826143 25234 raft_consensus.cc:392] T 5276bce755e042379220edc02e7b8f09 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:27.826205 25234 raft_consensus.cc:787] T 5276bce755e042379220edc02e7b8f09 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Initialized, Role: FOLLOWER
I20261120 09:03:27.826490 25234 consensus_queue.cc:261] T 5276bce755e042379220edc02e7b8f09 P 2fb9ff0dc3d849d7bcf95806233d2c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.829617 25234 ts_tablet_manager.cc:1480] T 5276bce755e042379220edc02e7b8f09 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.002s
I20261120 09:03:27.830000 25234 tablet_bootstrap.cc:492] T 32a60fc620aa4027b4653877225c0604 P 2fb9ff0dc3d849d7bcf95806233d2c62: Bootstrap starting.
I20261120 09:03:27.833736 25234 tablet_bootstrap.cc:654] T 32a60fc620aa4027b4653877225c0604 P 2fb9ff0dc3d849d7bcf95806233d2c62: Neither blocks nor log segments found. Creating new log.
I20261120 09:03:27.840605 25234 tablet_bootstrap.cc:492] T 32a60fc620aa4027b4653877225c0604 P 2fb9ff0dc3d849d7bcf95806233d2c62: No bootstrap required, opened a new log
I20261120 09:03:27.840745 25234 ts_tablet_manager.cc:1449] T 32a60fc620aa4027b4653877225c0604 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent bootstrapping tablet: real 0.011s	user 0.006s	sys 0.002s
I20261120 09:03:27.841516 25234 raft_consensus.cc:366] T 32a60fc620aa4027b4653877225c0604 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.841691 25234 raft_consensus.cc:392] T 32a60fc620aa4027b4653877225c0604 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261120 09:03:27.841770 25234 raft_consensus.cc:787] T 32a60fc620aa4027b4653877225c0604 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Initialized, Role: FOLLOWER
I20261120 09:03:27.842005 25234 consensus_queue.cc:261] T 32a60fc620aa4027b4653877225c0604 P 2fb9ff0dc3d849d7bcf95806233d2c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.845449 25234 ts_tablet_manager.cc:1480] T 32a60fc620aa4027b4653877225c0604 P 2fb9ff0dc3d849d7bcf95806233d2c62: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.001s
I20261120 09:03:27.897957 25290 raft_consensus.cc:534] T 0bac0a6b89f34c549c5118605ed0acbf P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:27.898175 25290 raft_consensus.cc:556] T 0bac0a6b89f34c549c5118605ed0acbf P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.898954 25290 leader_election.cc:290] T 0bac0a6b89f34c549c5118605ed0acbf P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:27.899690 24509 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "0bac0a6b89f34c549c5118605ed0acbf" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3" is_pre_election: true
I20261120 09:03:27.899699 24805 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "0bac0a6b89f34c549c5118605ed0acbf" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46" is_pre_election: true
I20261120 09:03:27.900449 24595 leader_election.cc:304] T 0bac0a6b89f34c549c5118605ed0acbf P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:03:27.900785 25290 raft_consensus.cc:2966] T 0bac0a6b89f34c549c5118605ed0acbf P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20261120 09:03:27.930976 24743 connection.cc:573] server connection from 127.0.0.1:43964 recv error: Network error: recv error from unknown peer: Connection reset by peer (error 104)
W20261120 09:03:27.930986 24595 connection.cc:573] server connection from 127.0.0.1:40178 recv error: Network error: recv error from unknown peer: Connection reset by peer (error 104)
W20261120 09:03:27.931480 24444 connection.cc:573] server connection from 127.0.0.1:50052 recv error: Network error: recv error from unknown peer: Connection reset by peer (error 104)
W20261120 09:03:27.931582 24864 connection.cc:573] client connection to 127.23.79.126:41659 recv error: Network error: recv error from unknown peer: Connection reset by peer (error 104)
W20261120 09:03:27.932539 24864 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.23.79.126:41659)
W20261120 09:03:27.932850 24864 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.23.79.126:41659)
W20261120 09:03:27.932808 24307 connection.cc:573] server connection from 127.0.0.1:41744 recv error: Network error: recv error from unknown peer: Connection reset by peer (error 104)
W20261120 09:03:27.933267 24236 connection.cc:573] server connection from 127.0.0.1:60902 recv error: Network error: recv error from unknown peer: Connection reset by peer (error 104)
W20261120 09:03:27.933580 24864 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.23.79.126:41659)
I20261120 09:03:27.947556 25290 raft_consensus.cc:534] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20261120 09:03:27.946887 25318 negotiation.cc:336] Failed RPC negotiation. Trace:
1120 09:03:27.935175 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.23.79.126:41659 (local address 127.23.79.67:33851)
1120 09:03:27.946743 (+ 11568us) negotiation.cc:107] Waiting for socket to connect
1120 09:03:27.946851 (+   108us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":11460,"thread_start_us":11366,"threads_started":1}
I20261120 09:03:27.947770 25290 raft_consensus.cc:556] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
W20261120 09:03:27.946615 25319 negotiation.cc:336] Failed RPC negotiation. Trace:
1120 09:03:27.935191 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.23.79.126:41659 (local address 127.23.79.66:37561)
1120 09:03:27.946357 (+ 11166us) negotiation.cc:107] Waiting for socket to connect
1120 09:03:27.946566 (+   209us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":11051,"thread_start_us":10915,"threads_started":1}
I20261120 09:03:27.948501 25290 leader_election.cc:290] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:27.949090 24805 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "2ee53da425f54c4aaed62a9211d5c2f9" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46" is_pre_election: true
I20261120 09:03:27.949370 24805 raft_consensus.cc:2062] T 2ee53da425f54c4aaed62a9211d5c2f9 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 2fb9ff0dc3d849d7bcf95806233d2c62 in term 0
I20261120 09:03:27.949728 24509 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "2ee53da425f54c4aaed62a9211d5c2f9" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3" is_pre_election: true
I20261120 09:03:27.949973 24509 raft_consensus.cc:2062] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate 2fb9ff0dc3d849d7bcf95806233d2c62 in term 0
I20261120 09:03:27.949966 24595 leader_election.cc:304] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62, 8668dad23e404dafb0ac25267f07bd46; no voters: 
I20261120 09:03:27.950353 25290 raft_consensus.cc:3024] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261120 09:03:27.950547 25290 raft_consensus.cc:534] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261120 09:03:27.950670 25290 raft_consensus.cc:3296] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:27.951009 25290 raft_consensus.cc:556] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.953485 25290 leader_election.cc:290] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 election: Requested vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:27.953943 24509 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "2ee53da425f54c4aaed62a9211d5c2f9" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3"
I20261120 09:03:27.954010 24805 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "2ee53da425f54c4aaed62a9211d5c2f9" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46"
I20261120 09:03:27.954172 24509 raft_consensus.cc:3296] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2c3fe57b9d2c424da181281af303f3c3 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:27.954187 24805 raft_consensus.cc:3296] T 2ee53da425f54c4aaed62a9211d5c2f9 P 8668dad23e404dafb0ac25267f07bd46 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:27.954552 24509 raft_consensus.cc:2062] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2c3fe57b9d2c424da181281af303f3c3 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 2fb9ff0dc3d849d7bcf95806233d2c62 in term 1
I20261120 09:03:27.954701 24805 raft_consensus.cc:2062] T 2ee53da425f54c4aaed62a9211d5c2f9 P 8668dad23e404dafb0ac25267f07bd46 [term 1 FOLLOWER]: Leader election vote request: granting yes vote for candidate 2fb9ff0dc3d849d7bcf95806233d2c62 in term 1
I20261120 09:03:27.957684 24595 leader_election.cc:304] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c3fe57b9d2c424da181281af303f3c3, 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 
I20261120 09:03:27.958158 25290 raft_consensus.cc:3024] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 FOLLOWER]: Leader election won for term 1
I20261120 09:03:27.958298 25290 raft_consensus.cc:744] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 1 LEADER]: Becoming Leader. State: Replica: 2fb9ff0dc3d849d7bcf95806233d2c62, State: Running, Role: LEADER
I20261120 09:03:27.958585 25290 consensus_queue.cc:238] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2fb9ff0dc3d849d7bcf95806233d2c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.961910 25290 consensus_queue.cc:1049] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2fb9ff0dc3d849d7bcf95806233d2c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:27.962298 25290 consensus_queue.cc:1049] T 2ee53da425f54c4aaed62a9211d5c2f9 P 2fb9ff0dc3d849d7bcf95806233d2c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261120 09:03:27.995615 25290 raft_consensus.cc:534] T 565df75f345947bea84b343c454ea1be P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:27.995847 25290 raft_consensus.cc:556] T 565df75f345947bea84b343c454ea1be P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:27.996469 25290 leader_election.cc:290] T 565df75f345947bea84b343c454ea1be P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:27.997174 24805 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "565df75f345947bea84b343c454ea1be" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46" is_pre_election: true
I20261120 09:03:27.997269 24509 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "565df75f345947bea84b343c454ea1be" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3" is_pre_election: true
I20261120 09:03:27.997961 24595 leader_election.cc:304] T 565df75f345947bea84b343c454ea1be P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:03:27.998257 25290 raft_consensus.cc:2966] T 565df75f345947bea84b343c454ea1be P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:03:28.033126 23869 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu pid 24287
I20261120 09:03:28.034155 24351 generic_service.cc:196] Checking for leaks (request via RPC)
I20261120 09:03:28.040625 25290 raft_consensus.cc:534] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:28.040861 25290 raft_consensus.cc:556] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:28.041604 25290 leader_election.cc:290] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
W20261120 09:03:28.042426 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
W20261120 09:03:28.042749 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:03:28.042861 24595 leader_election.cc:304] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:03:28.043241 25290 raft_consensus.cc:2966] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:03:28.152070 25326 raft_consensus.cc:534] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:03:28.152287 25326 raft_consensus.cc:556] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:28.153115 25326 leader_election.cc:290] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881)
W20261120 09:03:28.154060 24238 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111) [suppressed 4 similar messages]
W20261120 09:03:28.155364 24238 leader_election.cc:336] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
I20261120 09:03:28.158213 25290 raft_consensus.cc:534] T 5276bce755e042379220edc02e7b8f09 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:28.158437 25290 raft_consensus.cc:556] T 5276bce755e042379220edc02e7b8f09 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:28.159111 25290 leader_election.cc:290] T 5276bce755e042379220edc02e7b8f09 P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:28.159685 24805 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "5276bce755e042379220edc02e7b8f09" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46" is_pre_election: true
I20261120 09:03:28.159794 24509 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "5276bce755e042379220edc02e7b8f09" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3" is_pre_election: true
I20261120 09:03:28.160389 24595 leader_election.cc:304] T 5276bce755e042379220edc02e7b8f09 P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:03:28.160682 25290 raft_consensus.cc:2966] T 5276bce755e042379220edc02e7b8f09 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:03:28.162261 24330 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d2b1940991ac40bd916579d581e689f4" candidate_term: 5 candidate_status { last_received { term: 4 index: 84 } } ignore_live_leader: false dest_uuid: "d82bf27d60fa450e8f941d1a9d36a825" is_pre_election: true
I20261120 09:03:28.162448 24330 raft_consensus.cc:2062] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 4 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate d2b1940991ac40bd916579d581e689f4 in term 4
I20261120 09:03:28.162878 24235 leader_election.cc:304] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2b1940991ac40bd916579d581e689f4, d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18
I20261120 09:03:28.163090 23869 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu with pid 24287
I20261120 09:03:28.163133 25326 raft_consensus.cc:3024] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20261120 09:03:28.163235 25326 raft_consensus.cc:534] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:03:28.163340 25326 raft_consensus.cc:3296] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 4 FOLLOWER]: Advancing to term 5
I20261120 09:03:28.168581 25326 raft_consensus.cc:556] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:28.169302 25326 leader_election.cc:290] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [CANDIDATE]: Term 5 election: Requested vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881)
W20261120 09:03:28.170567 24238 leader_election.cc:336] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:03:28.186002 24235 connection.cc:573] client connection to 127.23.79.124:33881 recv error: Network error: recv error from unknown peer: Connection reset by peer (error 104)
W20261120 09:03:28.187060 24235 leader_election.cc:336] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881): Network error: Client connection negotiation failed: client connection to 127.23.79.124:33881: connect: Connection refused (error 111)
I20261120 09:03:28.187177 24235 leader_election.cc:304] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2b1940991ac40bd916579d581e689f4; no voters: a99947e985094a3e8999fe2aa4e23f18, d82bf27d60fa450e8f941d1a9d36a825
I20261120 09:03:28.187489 25326 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20261120 09:03:28.251673 24660 raft_consensus.cc:3296] T 212960af80bf45deb7c508c3356d3391 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:28.318183 24660 raft_consensus.cc:3296] T 565df75f345947bea84b343c454ea1be P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:28.349363 25290 raft_consensus.cc:534] T 32a60fc620aa4027b4653877225c0604 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:28.349561 25290 raft_consensus.cc:556] T 32a60fc620aa4027b4653877225c0604 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:28.350066 25290 leader_election.cc:290] T 32a60fc620aa4027b4653877225c0604 P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:28.350536 24805 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "32a60fc620aa4027b4653877225c0604" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8668dad23e404dafb0ac25267f07bd46" is_pre_election: true
I20261120 09:03:28.350646 24509 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "32a60fc620aa4027b4653877225c0604" candidate_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3fe57b9d2c424da181281af303f3c3" is_pre_election: true
I20261120 09:03:28.351114 24595 leader_election.cc:304] T 32a60fc620aa4027b4653877225c0604 P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:03:28.351354 25290 raft_consensus.cc:2966] T 32a60fc620aa4027b4653877225c0604 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:03:28.389923 24660 raft_consensus.cc:3296] T 0bac0a6b89f34c549c5118605ed0acbf P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:28.886916 25338 raft_consensus.cc:534] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:28.887092 25338 raft_consensus.cc:556] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:28.887761 25338 leader_election.cc:290] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881)
W20261120 09:03:28.889746 24238 leader_election.cc:336] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:03:28.889994 24235 leader_election.cc:336] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881): Network error: Client connection negotiation failed: client connection to 127.23.79.124:33881: connect: Connection refused (error 111)
I20261120 09:03:28.890101 24235 leader_election.cc:304] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2b1940991ac40bd916579d581e689f4; no voters: a99947e985094a3e8999fe2aa4e23f18, d82bf27d60fa450e8f941d1a9d36a825
I20261120 09:03:28.890398 25338 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20261120 09:03:28.928275 23869 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu
/tmp/dist-test-taskH9EWc6/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.79.124:33881
--webserver_interface=127.23.79.124
--webserver_port=39545
--builtin_ntp_servers=127.23.79.84:36147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881
--hive_metastore_uris=thrift://127.0.0.1:38755
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20261120 09:03:28.944092 24660 raft_consensus.cc:3296] T 32a60fc620aa4027b4653877225c0604 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Advancing to term 1
I20261120 09:03:28.985982 24660 raft_consensus.cc:3296] T 5276bce755e042379220edc02e7b8f09 P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Advancing to term 1
W20261120 09:03:29.274072 25344 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261120 09:03:29.274353 25344 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261120 09:03:29.274420 25344 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261120 09:03:29.282464 25344 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20261120 09:03:29.282596 25344 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261120 09:03:29.282665 25344 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20261120 09:03:29.282711 25344 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20261120 09:03:29.292829 25344 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.79.84:36147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:38755
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.79.124:33881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.23.79.124
--webserver_port=39545
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 36b6772d828145f8fbba3c49746c86838683f9ba
build type FASTDEBUG
built by None at 20 Nov 2026 08:44:26 UTC on bdcb31816ec0
build id 14873
ASAN enabled
I20261120 09:03:29.294360 25344 env_posix.cc:2337] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261120 09:03:29.296106 25344 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261120 09:03:29.304304 25357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261120 09:03:29.304407 25359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261120 09:03:29.304330 25356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261120 09:03:29.305378 25344 server_base.cc:1061] running on GCE node
I20261120 09:03:29.306119 25344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261120 09:03:29.307442 25344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261120 09:03:29.308631 25344 hybrid_clock.cc:648] HybridClock initialized: now 1795165409308580 us; error 53 us; skew 500 ppm
I20261120 09:03:29.308943 25344 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261120 09:03:29.311062 25344 webserver.cc:577] Webserver started at http://127.23.79.124:39545/ using document root <none> and password file <none>
I20261120 09:03:29.311717 25344 fs_manager.cc:362] Metadata directory not provided
I20261120 09:03:29.311839 25344 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261120 09:03:29.317111 25344 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.003s
I20261120 09:03:29.319736 25365 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261120 09:03:29.321061 25344 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20261120 09:03:29.321245 25344 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data,/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/wal
uuid: "d82bf27d60fa450e8f941d1a9d36a825"
format_stamp: "Formatted at 2026-11-20 09:03:20 on dist-test-slave-vzd6"
I20261120 09:03:29.321902 25344 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261120 09:03:29.337649 25344 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261120 09:03:29.338380 25344 env_posix.cc:2337] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261120 09:03:29.338686 25344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261120 09:03:29.359033 25344 rpc_server.cc:307] RPC server started. Bound to: 127.23.79.124:33881
I20261120 09:03:29.359054 25416 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.79.124:33881 every 8 connection(s)
I20261120 09:03:29.360610 25344 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data/info.pb
I20261120 09:03:29.366201 23869 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu as pid 25344
I20261120 09:03:29.367439 25417 sys_catalog.cc:263] Verifying existing consensus state
I20261120 09:03:29.371729 25417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: Bootstrap starting.
I20261120 09:03:29.388072 25417 log.cc:826] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: Log is configured to *not* fsync() on all Append() calls
I20261120 09:03:29.435251 24854 heartbeater.cc:345] Connected to a master server at 127.23.79.124:33881
I20261120 09:03:29.453220 25417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: Bootstrap replayed 1/1 log segments. Stats: ops{read=84 overwritten=0 applied=84 ignored=0} inserts{seen=62 ignored=0} mutations{seen=70 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261120 09:03:29.453801 25417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: Bootstrap complete.
I20261120 09:03:29.459297 25417 raft_consensus.cc:366] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:29.460067 25417 raft_consensus.cc:787] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: d82bf27d60fa450e8f941d1a9d36a825, State: Initialized, Role: FOLLOWER
I20261120 09:03:29.460649 25417 consensus_queue.cc:261] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 84, Last appended: 4.84, Last appended by leader: 84, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:29.461351 25423 sys_catalog.cc:455] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:29.461579 25423 sys_catalog.cc:458] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:29.462596 25417 sys_catalog.cc:565] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: configured and running, proceeding with master startup.
I20261120 09:03:29.470449 25344 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:03:29.475908 25344 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:03:29.476091 25437 catalog_manager.cc:1310] Loaded cluster ID: b96ccaeeefb845f4962e35569b62531b
I20261120 09:03:29.476197 25437 catalog_manager.cc:1603] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: loading cluster ID for follower catalog manager: success
I20261120 09:03:29.480499 25437 catalog_manager.cc:1625] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: acquiring CA information for follower catalog manager: success
I20261120 09:03:29.483357 25437 catalog_manager.cc:1653] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20261120 09:03:29.506292 24707 heartbeater.cc:345] Connected to a master server at 127.23.79.124:33881
I20261120 09:03:29.506408 24562 heartbeater.cc:345] Connected to a master server at 127.23.79.124:33881
I20261120 09:03:29.509099 25382 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" instance_seqno: 1795165401200304) as {username='slave'} at 127.23.79.65:50527; Asking this server to re-register.
I20261120 09:03:29.509076 25381 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" instance_seqno: 1795165401905746) as {username='slave'} at 127.23.79.66:40523; Asking this server to re-register.
I20261120 09:03:29.509894 24707 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:29.509948 24562 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:29.511976 25382 ts_manager.cc:210] Registered new tserver with Master: 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:29.512171 25381 ts_manager.cc:210] Registered new tserver with Master: 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879)
I20261120 09:03:29.710480 25444 raft_consensus.cc:534] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:29.710824 25444 raft_consensus.cc:556] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:29.711645 25444 leader_election.cc:290] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881)
W20261120 09:03:29.723042 24238 leader_election.cc:336] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
I20261120 09:03:29.723363 25392 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d2b1940991ac40bd916579d581e689f4" candidate_term: 6 candidate_status { last_received { term: 4 index: 84 } } ignore_live_leader: false dest_uuid: "d82bf27d60fa450e8f941d1a9d36a825" is_pre_election: true
I20261120 09:03:29.724097 25392 raft_consensus.cc:2062] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 4 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate d2b1940991ac40bd916579d581e689f4 in term 4
I20261120 09:03:29.724982 24235 leader_election.cc:304] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2b1940991ac40bd916579d581e689f4, d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18
I20261120 09:03:29.725293 25444 raft_consensus.cc:3024] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20261120 09:03:29.725404 25444 raft_consensus.cc:534] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261120 09:03:29.725502 25444 raft_consensus.cc:3296] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 5 FOLLOWER]: Advancing to term 6
I20261120 09:03:29.726114 25444 raft_consensus.cc:556] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:29.729852 25444 leader_election.cc:290] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [CANDIDATE]: Term 6 election: Requested vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881)
I20261120 09:03:29.730464 25392 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d2b1940991ac40bd916579d581e689f4" candidate_term: 6 candidate_status { last_received { term: 4 index: 84 } } ignore_live_leader: false dest_uuid: "d82bf27d60fa450e8f941d1a9d36a825"
I20261120 09:03:29.730708 25392 raft_consensus.cc:3296] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 4 FOLLOWER]: Advancing to term 6
I20261120 09:03:29.731266 25392 raft_consensus.cc:2062] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Leader election vote request: granting yes vote for candidate d2b1940991ac40bd916579d581e689f4 in term 6
W20261120 09:03:29.731508 24238 leader_election.cc:336] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
I20261120 09:03:29.735787 24235 leader_election.cc:304] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2b1940991ac40bd916579d581e689f4, d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18
I20261120 09:03:29.736110 25444 raft_consensus.cc:3024] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 6 FOLLOWER]: Leader election won for term 6
I20261120 09:03:29.736258 25444 raft_consensus.cc:744] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [term 6 LEADER]: Becoming Leader. State: Replica: d2b1940991ac40bd916579d581e689f4, State: Running, Role: LEADER
I20261120 09:03:29.736574 25444 consensus_queue.cc:238] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 84, Committed index: 84, Last appended: 4.84, Last appended by leader: 84, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:29.737879 25448 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2b1940991ac40bd916579d581e689f4. Latest consensus state: current_term: 6 leader_uuid: "d2b1940991ac40bd916579d581e689f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:29.738348 25448 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [sys.catalog]: This master's current role is: LEADER
I20261120 09:03:29.739130 25451 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261120 09:03:29.740679 25392 raft_consensus.cc:1338] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Refusing update from remote peer d2b1940991ac40bd916579d581e689f4: Log matching property violated. Preceding OpId in replica: term: 4 index: 84. Preceding OpId from leader: term: 6 index: 85. (index mismatch)
I20261120 09:03:29.741889 25448 consensus_queue.cc:1049] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 85, Last known committed idx: 84, Time since last communication: 0.000s
I20261120 09:03:29.742964 25451 catalog_manager.cc:694] Loaded metadata for table default.table_797fe36dbbf14c0c8e085d8470e75a24 [id=07e09703ed284b73a0c9915d40065e82]
I20261120 09:03:29.743577 25451 catalog_manager.cc:694] Loaded metadata for table default.table_5b01ae1724c5451c8ac9c936c5c8c983 [id=0bfc8c6dc2e94a92b142bee12f2b88e8]
I20261120 09:03:29.744127 25451 catalog_manager.cc:694] Loaded metadata for table default.table_4a315c29012549dcab8e1d9373f99f30 [id=1513ff7b0a7c4bcb9127e67296a844c5]
I20261120 09:03:29.744819 25451 catalog_manager.cc:694] Loaded metadata for table default.table_b2351eb1045a47feb0ca7b7422706581 [id=268c82ae3c7448059e7674f73aad3114]
I20261120 09:03:29.745293 25451 catalog_manager.cc:694] Loaded metadata for table default.table_f9f890b63b384c3b9f30da0ba8a80c03 [id=315bdedf9fe44e5d866534884f65f6d4]
I20261120 09:03:29.746074 25451 catalog_manager.cc:694] Loaded metadata for table default.table_6a2be3a544144a99b0f343bca3024912 [id=35553b36397740a29f2588fd2a840c61]
I20261120 09:03:29.746623 25451 catalog_manager.cc:694] Loaded metadata for table default.table_b329d3b2bb9a409b9290011073304555 [id=3f913310fd9a49b6b264540325c0139e]
I20261120 09:03:29.747117 25451 catalog_manager.cc:694] Loaded metadata for table default.table_414553f5c3994f4097d7fdbf9dc01082 [id=55152bf51e49475ea6391839e6630cd0]
I20261120 09:03:29.747663 25451 catalog_manager.cc:694] Loaded metadata for table default.table_f0940064a6844fdaadb8859f4257b11f [id=6a7afe82b2724dccb508eb95158c7ec7]
I20261120 09:03:29.748193 25451 catalog_manager.cc:694] Loaded metadata for table default.table_67a0134c1cdf49a49bea9d4b2818b558 [id=7510ae7af246485ca9d5b539b3f90bbb]
I20261120 09:03:29.748919 25451 catalog_manager.cc:694] Loaded metadata for table default.table_0d4b09a9b1754e38bca62e97c14a0854 [id=83bafe99e25046a4a43a3739a3ca07a1]
I20261120 09:03:29.749421 25451 catalog_manager.cc:694] Loaded metadata for table default.table_5f2e35d59fff4bc89139835f148d0414 [id=86b210ad5a5d4f66ad1c8da6ec85dc53]
I20261120 09:03:29.751246 25451 catalog_manager.cc:694] Loaded metadata for table default.table_4d5337371cd3454fa5aae228272e5fda [id=90570e46cebe47eba97e5b980f23e909]
I20261120 09:03:29.751299 25423 sys_catalog.cc:455] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2b1940991ac40bd916579d581e689f4. Latest consensus state: current_term: 6 leader_uuid: "d2b1940991ac40bd916579d581e689f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:29.751598 25423 sys_catalog.cc:458] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:29.751775 25451 catalog_manager.cc:694] Loaded metadata for table default.table_d68821f474e040e18b4d91fbbd850863 [id=9d133f08f71d42b89628f2869cbaa424]
I20261120 09:03:29.752188 25451 catalog_manager.cc:694] Loaded metadata for table default.table_784f78c485a74606a638a81633a149e7 [id=aa6cfb171b4c482caa17d7c0862da3d0]
I20261120 09:03:29.752671 25451 catalog_manager.cc:694] Loaded metadata for table default.table_c622167e221c4db9953d7a278bd41411 [id=b21dc844213f4fc8b0f28c935f221a1b]
I20261120 09:03:29.753394 25451 catalog_manager.cc:694] Loaded metadata for table default.table_39131cc9c462405ba3639c841ebfe256 [id=cb55967ea90e43be8da1354763f7984c]
W20261120 09:03:29.754066 24238 consensus_peers.cc:597] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 -> Peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Couldn't send request to peer a99947e985094a3e8999fe2aa4e23f18. Status: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20261120 09:03:29.754237 25451 catalog_manager.cc:694] Loaded metadata for table default.table_1a335d2b826a4f21a34ac38ad85ff200 [id=d16648dc14594d6db8143aaa02f420a5]
I20261120 09:03:29.754904 25451 catalog_manager.cc:694] Loaded metadata for table default.table_d67fc59080cc4194b566604a649aefad [id=ec464d0cd5ec4ec2bc03ebb8a14481e0]
I20261120 09:03:29.758397 25448 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "d2b1940991ac40bd916579d581e689f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:29.758963 25448 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4 [sys.catalog]: This master's current role is: LEADER
I20261120 09:03:29.759708 25423 sys_catalog.cc:455] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "d2b1940991ac40bd916579d581e689f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:29.759922 25423 sys_catalog.cc:458] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:29.761175 25451 tablet_loader.cc:96] loaded metadata for tablet 0bac0a6b89f34c549c5118605ed0acbf (table default.table_414553f5c3994f4097d7fdbf9dc01082 [id=55152bf51e49475ea6391839e6630cd0])
I20261120 09:03:29.761557 25451 tablet_loader.cc:96] loaded metadata for tablet 18019fa55aae42be8fb9e5421dd45630 (table default.table_0d4b09a9b1754e38bca62e97c14a0854 [id=83bafe99e25046a4a43a3739a3ca07a1])
I20261120 09:03:29.761853 25451 tablet_loader.cc:96] loaded metadata for tablet 212960af80bf45deb7c508c3356d3391 (table default.table_c622167e221c4db9953d7a278bd41411 [id=b21dc844213f4fc8b0f28c935f221a1b])
I20261120 09:03:29.762141 25451 tablet_loader.cc:96] loaded metadata for tablet 26f97270103e4956b82be66244c71301 (table default.table_39131cc9c462405ba3639c841ebfe256 [id=cb55967ea90e43be8da1354763f7984c])
I20261120 09:03:29.762415 25451 tablet_loader.cc:96] loaded metadata for tablet 2ee53da425f54c4aaed62a9211d5c2f9 (table default.table_5b01ae1724c5451c8ac9c936c5c8c983 [id=0bfc8c6dc2e94a92b142bee12f2b88e8])
I20261120 09:03:29.762773 25451 tablet_loader.cc:96] loaded metadata for tablet 32a60fc620aa4027b4653877225c0604 (table default.table_5f2e35d59fff4bc89139835f148d0414 [id=86b210ad5a5d4f66ad1c8da6ec85dc53])
I20261120 09:03:29.763089 25451 tablet_loader.cc:96] loaded metadata for tablet 5276bce755e042379220edc02e7b8f09 (table default.table_6a2be3a544144a99b0f343bca3024912 [id=35553b36397740a29f2588fd2a840c61])
I20261120 09:03:29.763396 25451 tablet_loader.cc:96] loaded metadata for tablet 565df75f345947bea84b343c454ea1be (table default.table_1a335d2b826a4f21a34ac38ad85ff200 [id=d16648dc14594d6db8143aaa02f420a5])
I20261120 09:03:29.763720 25451 tablet_loader.cc:96] loaded metadata for tablet 6130d88766ca4ced867fb83be00a00f5 (table default.table_67a0134c1cdf49a49bea9d4b2818b558 [id=7510ae7af246485ca9d5b539b3f90bbb])
I20261120 09:03:29.764168 25451 tablet_loader.cc:96] loaded metadata for tablet 707757cc32af4fe98d4a04e6a7498c17 (table default.table_4d5337371cd3454fa5aae228272e5fda [id=90570e46cebe47eba97e5b980f23e909])
I20261120 09:03:29.764475 25451 tablet_loader.cc:96] loaded metadata for tablet 75e156478a8a470ba5f4942cd8e6a89e (table default.table_f9f890b63b384c3b9f30da0ba8a80c03 [id=315bdedf9fe44e5d866534884f65f6d4])
I20261120 09:03:29.764784 25451 tablet_loader.cc:96] loaded metadata for tablet 8155295b7e8e40ddaedeb2e9c24f1245 (table default.table_b2351eb1045a47feb0ca7b7422706581 [id=268c82ae3c7448059e7674f73aad3114])
I20261120 09:03:29.765247 25451 tablet_loader.cc:96] loaded metadata for tablet a27e6c05e40742d4ab0116c2e22cd4ba (table default.table_784f78c485a74606a638a81633a149e7 [id=aa6cfb171b4c482caa17d7c0862da3d0])
I20261120 09:03:29.765635 25451 tablet_loader.cc:96] loaded metadata for tablet a48b8166531548208bf3ae77f7380555 (table default.table_d67fc59080cc4194b566604a649aefad [id=ec464d0cd5ec4ec2bc03ebb8a14481e0])
I20261120 09:03:29.766350 25451 tablet_loader.cc:96] loaded metadata for tablet ab6cc162ae404f91a484d70756e3897f (table default.table_b329d3b2bb9a409b9290011073304555 [id=3f913310fd9a49b6b264540325c0139e])
I20261120 09:03:29.767992 25451 tablet_loader.cc:96] loaded metadata for tablet bf5c1cdd4f5c4ce6b89f099b65629910 (table default.table_797fe36dbbf14c0c8e085d8470e75a24 [id=07e09703ed284b73a0c9915d40065e82])
I20261120 09:03:29.768560 25451 tablet_loader.cc:96] loaded metadata for tablet cb09ac7d6f3c42a6b5f7cf5a900f177f (table default.table_4a315c29012549dcab8e1d9373f99f30 [id=1513ff7b0a7c4bcb9127e67296a844c5])
I20261120 09:03:29.769114 25451 tablet_loader.cc:96] loaded metadata for tablet e4979050b3154c6292e42c8a3f7c89e7 (table default.table_f0940064a6844fdaadb8859f4257b11f [id=6a7afe82b2724dccb508eb95158c7ec7])
I20261120 09:03:29.769498 25451 tablet_loader.cc:96] loaded metadata for tablet e7f41973f62a48cf8b20ec4d965bfa6e (table default.table_d68821f474e040e18b4d91fbbd850863 [id=9d133f08f71d42b89628f2869cbaa424])
I20261120 09:03:29.770081 25451 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261120 09:03:29.770457 25381 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" instance_seqno: 1795165402395308) as {username='slave'} at 127.23.79.67:38869; Asking this server to re-register.
I20261120 09:03:29.771226 24854 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:29.771603 25451 catalog_manager.cc:1310] Loaded cluster ID: b96ccaeeefb845f4962e35569b62531b
I20261120 09:03:29.771706 25451 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261120 09:03:29.773180 25381 ts_manager.cc:210] Registered new tserver with Master: 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:29.773680 25451 catalog_manager.cc:1555] Loading token signing keys...
I20261120 09:03:29.775034 25451 catalog_manager.cc:6248] T 00000000000000000000000000000000 P d2b1940991ac40bd916579d581e689f4: Loaded TSK: 0
I20261120 09:03:29.775527 25451 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261120 09:03:29.776366 25451 catalog_manager.cc:1578] Loading latest processed Hive Metastore notification log event ID...
I20261120 09:03:29.777309 25451 catalog_manager.cc:6086] Last processed Hive Metastore notification event ID: 21
I20261120 09:03:29.791342 24242 catalog_manager.cc:2551] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60894:
table { table_name: "default.Table_414553f5c3994f4097d7fdbf9dc01082" } modify_external_catalogs: true
I20261120 09:03:29.791416 24248 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60894:
name: "default.Table_f2fb9ef502034f008e49c58af534c051"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:29.791003 24244 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60894:
name: "default.Table_3e4fc42431704219b0f8051a3136c83a"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:29.795744 24242 catalog_manager.cc:2799] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60894:
table { table_name: "default.Table_414553f5c3994f4097d7fdbf9dc01082" } modify_external_catalogs: true
I20261120 09:03:29.791114 24243 catalog_manager.cc:2551] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60894:
table { table_name: "default.Table_0d4b09a9b1754e38bca62e97c14a0854" } modify_external_catalogs: true
I20261120 09:03:29.790607 24246 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60894:
name: "default.Table_91e59d6c54de41a5a752a2e1fd1f6e39"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:29.791535 24251 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60894:
name: "default.Table_f6ee17074f64413d83d4f493d9a927e4"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:29.796073 24243 catalog_manager.cc:2799] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60894:
table { table_name: "default.Table_0d4b09a9b1754e38bca62e97c14a0854" } modify_external_catalogs: true
I20261120 09:03:29.791661 24249 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60894:
name: "default.Table_56741a54b26940a4b7bfc970e41960ac"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:29.791854 24245 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60894:
name: "default.Table_3fd14a71eb6b4a6c88dbaf4a470f6361"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:29.792001 24247 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60894:
name: "default.Table_2db1fa040e8a4eae9a2eaa62637fb6eb"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:29.790037 24250 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60894:
name: "default.Table_ebc744ebb12d4dd498ca3721c3b9ac6a"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
F20261120 09:03:29.803946 24419 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 26, previous 26; dumping first 6 out of 15 received events: NotificationEvent(eventId=22, eventTime=1795165406, eventType=CREATE_TABLE, dbName=default, tableName=table_c622167e221c4db9953d7a278bd41411, message={"server":"","servicePrincipal":"","db":"default","table":"table_c622167e221c4db9953d7a278bd41411","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_c622167e221c4db9953d7a278bd41411\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1795165406},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/warehouse/table_c622167e221c4db9953d7a278bd41411\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_c622167e221c4db9953d7a278bd41411\",\"kudu.table_id\":\"b21dc844213f4fc8b0f28c935f221a1b\",\"transient_lastDdlTime\":\"1795165406\",\"comment\":\"\",\"kudu.master_addresses\":\"127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"b96ccaeeefb845f4962e35569b62531b\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1795165406,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1795165406, eventType=DROP_TABLE, dbName=default, tableName=table_d68821f474e040e18b4d91fbbd850863, message={"server":"","servicePrincipal":"","db":"default","table":"table_d68821f474e040e18b4d91fbbd850863","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_d68821f474e040e18b4d91fbbd850863\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1795165403},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/warehouse/table_d68821f474e040e18b4d91fbbd850863\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_d68821f474e040e18b4d91fbbd850863\",\"kudu.table_id\":\"9d133f08f71d42b89628f2869cbaa424\",\"transient_lastDdlTime\":\"1795165403\",\"comment\":\"\",\"kudu.master_addresses\":\"127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"b96ccaeeefb845f4962e35569b62531b\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1795165406}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=24, eventTime=1795165407, eventType=ALTER_TABLE, dbName=default, tableName=table_a63a3233f7d94bf99010f9b0c7cb365e, message={"server":"","servicePrincipal":"","db":"default","table":"table_39131cc9c462405ba3639c841ebfe256","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_39131cc9c462405ba3639c841ebfe256\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1795165402},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/warehouse/table_39131cc9c462405ba3639c841ebfe256\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_39131cc9c462405ba3639c841ebfe256\",\"kudu.table_id\":\"cb55967ea90e43be8da1354763f7984c\",\"transient_lastDdlTime\":\"1795165402\",\"comment\":\"\",\"kudu.master_addresses\":\"127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"b96ccaeeefb845f4962e35569b62531b\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_a63a3233f7d94bf99010f9b0c7cb365e\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1795165402},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/warehouse/table_a63a3233f7d94bf99010f9b0c7cb365e\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a63a3233f7d94bf99010f9b0c7cb365e\",\"kudu.table_id\":\"cb55967ea90e43be8da1354763f7984c\",\"transient_lastDdlTime\":\"1795165402\",\"comment\":\"\",\"kudu.master_addresses\":\"127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"b96ccaeeefb845f4962e35569b62531b\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1795165407}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=25, eventTime=1795165407, eventType=DROP_TABLE, dbName=default, tableName=table_d67fc59080cc4194b566604a649aefad, message={"server":"","servicePrincipal":"","db":"default","table":"table_d67fc59080cc4194b566604a649aefad","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_d67fc59080cc4194b566604a649aefad\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1795165403},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/warehouse/table_d67fc59080cc4194b566604a649aefad\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_d67fc59080cc4194b566604a649aefad\",\"kudu.table_id\":\"ec464d0cd5ec4ec2bc03ebb8a14481e0\",\"transient_lastDdlTime\":\"1795165403\",\"comment\":\"\",\"kudu.master_addresses\":\"127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"b96ccaeeefb845f4962e35569b62531b\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1795165407}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=26, eventTime=1795165407, eventType=CREATE_TABLE, dbName=default, tableName=table_414553f5c3994f4097d7fdbf9dc01082, message={"server":"","servicePrincipal":"","db":"default","table":"table_414553f5c3994f4097d7fdbf9dc01082","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_414553f5c3994f4097d7fdbf9dc01082\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1795165407},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/warehouse/table_414553f5c3994f4097d7fdbf9dc01082\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_414553f5c3994f4097d7fdbf9dc01082\",\"kudu.table_id\":\"55152bf51e49475ea6391839e6630cd0\",\"transient_lastDdlTime\":\"1795165407\",\"comment\":\"\",\"kudu.master_addresses\":\"127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"b96ccaeeefb845f4962e35569b62531b\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1795165407,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=26, eventTime=1795165407, eventType=CREATE_TABLE, dbName=default, tableName=table_ebc744ebb12d4dd498ca3721c3b9ac6a, message={"server":"","servicePrincipal":"","db":"default","table":"table_ebc744ebb12d4dd498ca3721c3b9ac6a","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_ebc744ebb12d4dd498ca3721c3b9ac6a\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1795165407},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/warehouse/table_ebc744ebb12d4dd498ca3721c3b9ac6a\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_ebc744ebb12d4dd498ca3721c3b9ac6a\",\"kudu.table_id\":\"30da2006c3bb45c2b945f08d7cbe6945\",\"transient_lastDdlTime\":\"1795165407\",\"comment\":\"\",\"kudu.master_addresses\":\"127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"b96ccaeeefb845f4962e35569b62531b\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1795165407,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
    @     0x7ffadee78d5d  google::LogMessage::Fail() at ??:0
    @     0x7ffadee7cb23  google::LogMessage::SendToLog() at ??:0
    @     0x7ffadee7875c  google::LogMessage::Flush() at ??:0
    @     0x7ffadee789a1  google::LogMessage::~LogMessage() at ??:0
    @     0x7ffaf43483f4  kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
    @     0x7ffaf4346ca1  kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
    @     0x7ffaf434e91c  kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
    @     0x7ffaf434e799  std::_Function_handler<>::_M_invoke() at ??:0
    @           0x372c7d  std::function<>::operator()() at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/../sanitizer_common/sanitizer_common_interceptors.inc:5196
    @     0x7ffae02c2dd9  kudu::Thread::SuperviseThread() at ??:0
    @     0x7ffae39ab6db  start_thread at ??:0
    @     0x7ffadc40c61f  clone at ??:0
W20261120 09:03:30.021169 24597 connection.cc:573] client connection to 127.23.79.125:45319 recv error: Network error: recv error from unknown peer: Connection reset by peer (error 104)
W20261120 09:03:30.021785 24863 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.23.79.125:45319)
W20261120 09:03:30.021782 24445 connection.cc:573] client connection to 127.23.79.125:45319 recv error: Network error: recv error from unknown peer: Connection reset by peer (error 104)
W20261120 09:03:30.022020 24863 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.23.79.125:45319)
W20261120 09:03:30.022238 24863 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.23.79.125:45319)
W20261120 09:03:30.023782 24863 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.23.79.125:45319)
I20261120 09:03:30.255412 25423 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d2b1940991ac40bd916579d581e689f4)
I20261120 09:03:30.255622 25423 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:30.257381 25423 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:03:30.258301 25369 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:03:30.259764 25369 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:03:30.260349 25368 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:03:30.260453 25368 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:03:30.260828 25423 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20261120 09:03:30.777616 25474 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d2b1940991ac40bd916579d581e689f4)
I20261120 09:03:30.777784 25474 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:30.778584 25474 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:03:30.780611 25369 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:03:30.780887 25368 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:03:30.781035 25368 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:03:30.781302 25474 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20261120 09:03:31.409934 25478 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d2b1940991ac40bd916579d581e689f4)
I20261120 09:03:31.410122 25478 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:31.410805 25478 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:03:31.412926 25368 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:03:31.413281 25369 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
I20261120 09:03:31.413420 25369 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:03:31.413723 25478 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20261120 09:03:31.897696 23869 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu pid 25344
I20261120 09:03:31.908365 25412 generic_service.cc:196] Checking for leaks (request via RPC)
I20261120 09:03:32.016248 23869 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu with pid 25344
I20261120 09:03:32.432227 25290 raft_consensus.cc:534] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:32.432432 25290 raft_consensus.cc:556] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:32.433019 25290 leader_election.cc:290] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
W20261120 09:03:32.433864 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
W20261120 09:03:32.434072 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:03:32.434201 24595 leader_election.cc:304] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:03:32.434477 25290 raft_consensus.cc:2966] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:03:32.916267 23869 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu
/tmp/dist-test-taskH9EWc6/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.79.124:33881
--webserver_interface=127.23.79.124
--webserver_port=39545
--builtin_ntp_servers=127.23.79.84:36147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881
--hive_metastore_uris=thrift://127.0.0.1:38755
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20261120 09:03:33.266919 25489 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261120 09:03:33.267233 25489 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261120 09:03:33.267385 25489 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261120 09:03:33.275749 25489 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20261120 09:03:33.275846 25489 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261120 09:03:33.275938 25489 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20261120 09:03:33.276014 25489 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20261120 09:03:33.284904 25489 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.79.84:36147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:38755
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.79.124:33881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.23.79.124
--webserver_port=39545
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 36b6772d828145f8fbba3c49746c86838683f9ba
build type FASTDEBUG
built by None at 20 Nov 2026 08:44:26 UTC on bdcb31816ec0
build id 14873
ASAN enabled
I20261120 09:03:33.286465 25489 env_posix.cc:2337] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261120 09:03:33.288188 25489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261120 09:03:33.295981 25495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261120 09:03:33.296007 25496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261120 09:03:33.297024 25498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261120 09:03:33.298102 25489 server_base.cc:1061] running on GCE node
I20261120 09:03:33.299031 25489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261120 09:03:33.300796 25489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261120 09:03:33.302017 25489 hybrid_clock.cc:648] HybridClock initialized: now 1795165413301955 us; error 54 us; skew 500 ppm
I20261120 09:03:33.302388 25489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261120 09:03:33.304484 25489 webserver.cc:577] Webserver started at http://127.23.79.124:39545/ using document root <none> and password file <none>
I20261120 09:03:33.305186 25489 fs_manager.cc:362] Metadata directory not provided
I20261120 09:03:33.305311 25489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261120 09:03:33.310602 25489 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.001s
I20261120 09:03:33.313216 25504 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261120 09:03:33.314692 25489 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20261120 09:03:33.314848 25489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data,/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/wal
uuid: "d82bf27d60fa450e8f941d1a9d36a825"
format_stamp: "Formatted at 2026-11-20 09:03:20 on dist-test-slave-vzd6"
I20261120 09:03:33.315480 25489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261120 09:03:33.350253 25489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261120 09:03:33.351159 25489 env_posix.cc:2337] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261120 09:03:33.351473 25489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261120 09:03:33.372263 25489 rpc_server.cc:307] RPC server started. Bound to: 127.23.79.124:33881
I20261120 09:03:33.372275 25555 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.79.124:33881 every 8 connection(s)
I20261120 09:03:33.373893 25489 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data/info.pb
I20261120 09:03:33.375523 23869 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu as pid 25489
I20261120 09:03:33.383374 25556 sys_catalog.cc:263] Verifying existing consensus state
I20261120 09:03:33.388372 25556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: Bootstrap starting.
I20261120 09:03:33.404157 25556 log.cc:826] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: Log is configured to *not* fsync() on all Append() calls
I20261120 09:03:33.470927 25556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: Bootstrap replayed 1/1 log segments. Stats: ops{read=85 overwritten=0 applied=85 ignored=0} inserts{seen=62 ignored=0} mutations{seen=70 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261120 09:03:33.471500 25556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: Bootstrap complete.
I20261120 09:03:33.476524 25556 raft_consensus.cc:366] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:33.477308 25556 raft_consensus.cc:787] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: d82bf27d60fa450e8f941d1a9d36a825, State: Initialized, Role: FOLLOWER
I20261120 09:03:33.477916 25556 consensus_queue.cc:261] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 85, Last appended: 6.85, Last appended by leader: 85, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:33.478698 25562 sys_catalog.cc:455] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:33.478904 25562 sys_catalog.cc:458] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:33.479687 25556 sys_catalog.cc:565] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: configured and running, proceeding with master startup.
I20261120 09:03:33.492138 25576 catalog_manager.cc:1310] Loaded cluster ID: b96ccaeeefb845f4962e35569b62531b
I20261120 09:03:33.492311 25576 catalog_manager.cc:1603] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: loading cluster ID for follower catalog manager: success
I20261120 09:03:33.488801 25489 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:03:33.494428 25489 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:03:33.496690 25576 catalog_manager.cc:1625] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: acquiring CA information for follower catalog manager: success
I20261120 09:03:33.503980 25576 catalog_manager.cc:1653] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20261120 09:03:33.536875 24854 heartbeater.cc:345] Connected to a master server at 127.23.79.124:33881
I20261120 09:03:33.541627 25521 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" instance_seqno: 1795165402395308) as {username='slave'} at 127.23.79.67:59335; Asking this server to re-register.
I20261120 09:03:33.542924 24854 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:33.545535 25521 ts_manager.cc:210] Registered new tserver with Master: 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:33.548297 24707 heartbeater.cc:345] Connected to a master server at 127.23.79.124:33881
I20261120 09:03:33.548723 24562 heartbeater.cc:345] Connected to a master server at 127.23.79.124:33881
I20261120 09:03:33.550377 25521 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" instance_seqno: 1795165401905746) as {username='slave'} at 127.23.79.66:60677; Asking this server to re-register.
I20261120 09:03:33.551234 25520 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" instance_seqno: 1795165401200304) as {username='slave'} at 127.23.79.65:49823; Asking this server to re-register.
I20261120 09:03:33.553117 24562 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:33.553162 24707 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:33.554831 25520 ts_manager.cc:210] Registered new tserver with Master: 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:33.555109 25521 ts_manager.cc:210] Registered new tserver with Master: 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879)
I20261120 09:03:33.861321 25562 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:33.861654 25562 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:33.864140 25562 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:03:33.864648 25508 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:03:33.867039 25508 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:03:33.867712 25507 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:03:33.867839 25507 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:03:33.868234 25562 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20261120 09:03:34.503494 25588 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:34.503676 25588 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:34.504338 25588 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:03:34.506172 25507 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:03:34.506405 25508 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
I20261120 09:03:34.506526 25508 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:03:34.506775 25588 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20261120 09:03:35.400913 25601 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:35.401134 25601 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:35.401896 25601 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:03:35.404037 25507 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:03:35.404248 25508 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
I20261120 09:03:35.404366 25508 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:03:35.404712 25601 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20261120 09:03:35.542433 23869 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu pid 25489
I20261120 09:03:35.549206 25551 generic_service.cc:196] Checking for leaks (request via RPC)
I20261120 09:03:35.656303 23869 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu with pid 25489
I20261120 09:03:36.543685 23869 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu
/tmp/dist-test-taskH9EWc6/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.79.124:33881
--webserver_interface=127.23.79.124
--webserver_port=39545
--builtin_ntp_servers=127.23.79.84:36147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881
--hive_metastore_uris=thrift://127.0.0.1:38755
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20261120 09:03:36.883508 25619 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261120 09:03:36.883778 25619 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261120 09:03:36.883844 25619 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261120 09:03:36.892025 25619 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20261120 09:03:36.892102 25619 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261120 09:03:36.892150 25619 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20261120 09:03:36.892194 25619 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20261120 09:03:36.902200 25619 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.79.84:36147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:38755
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.79.124:33881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.23.79.124
--webserver_port=39545
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 36b6772d828145f8fbba3c49746c86838683f9ba
build type FASTDEBUG
built by None at 20 Nov 2026 08:44:26 UTC on bdcb31816ec0
build id 14873
ASAN enabled
I20261120 09:03:36.903838 25619 env_posix.cc:2337] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261120 09:03:36.905547 25619 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261120 09:03:36.913656 25625 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261120 09:03:36.914157 25624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261120 09:03:36.919353 25627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261120 09:03:36.924045 25619 server_base.cc:1061] running on GCE node
I20261120 09:03:36.924860 25619 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261120 09:03:36.926419 25619 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261120 09:03:36.927662 25619 hybrid_clock.cc:648] HybridClock initialized: now 1795165416927605 us; error 47 us; skew 500 ppm
I20261120 09:03:36.928035 25619 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261120 09:03:36.930933 25619 webserver.cc:577] Webserver started at http://127.23.79.124:39545/ using document root <none> and password file <none>
I20261120 09:03:36.931684 25619 fs_manager.cc:362] Metadata directory not provided
I20261120 09:03:36.931811 25619 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261120 09:03:36.937860 25619 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.002s	sys 0.004s
I20261120 09:03:36.940975 25633 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261120 09:03:36.942373 25619 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20261120 09:03:36.942615 25619 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data,/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/wal
uuid: "d82bf27d60fa450e8f941d1a9d36a825"
format_stamp: "Formatted at 2026-11-20 09:03:20 on dist-test-slave-vzd6"
I20261120 09:03:36.943269 25619 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261120 09:03:36.955140 25619 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261120 09:03:36.956044 25619 env_posix.cc:2337] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261120 09:03:36.956387 25619 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261120 09:03:36.977618 25684 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.79.124:33881 every 8 connection(s)
I20261120 09:03:36.977627 25619 rpc_server.cc:307] RPC server started. Bound to: 127.23.79.124:33881
I20261120 09:03:36.979401 25619 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data/info.pb
I20261120 09:03:36.986109 25685 sys_catalog.cc:263] Verifying existing consensus state
I20261120 09:03:36.989302 25685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: Bootstrap starting.
I20261120 09:03:36.989450 23869 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu as pid 25619
I20261120 09:03:37.009246 25685 log.cc:826] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: Log is configured to *not* fsync() on all Append() calls
I20261120 09:03:37.076545 25685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: Bootstrap replayed 1/1 log segments. Stats: ops{read=85 overwritten=0 applied=85 ignored=0} inserts{seen=62 ignored=0} mutations{seen=70 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261120 09:03:37.077131 25685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: Bootstrap complete.
I20261120 09:03:37.082242 25685 raft_consensus.cc:366] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:37.082899 25685 raft_consensus.cc:787] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: d82bf27d60fa450e8f941d1a9d36a825, State: Initialized, Role: FOLLOWER
I20261120 09:03:37.083549 25685 consensus_queue.cc:261] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 85, Last appended: 6.85, Last appended by leader: 85, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:37.084260 25691 sys_catalog.cc:455] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:37.084512 25691 sys_catalog.cc:458] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:37.085279 25685 sys_catalog.cc:565] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: configured and running, proceeding with master startup.
I20261120 09:03:37.098915 25705 catalog_manager.cc:1310] Loaded cluster ID: b96ccaeeefb845f4962e35569b62531b
I20261120 09:03:37.099005 25705 catalog_manager.cc:1603] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: loading cluster ID for follower catalog manager: success
I20261120 09:03:37.093983 25619 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:03:37.099610 25619 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:03:37.103294 25705 catalog_manager.cc:1625] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: acquiring CA information for follower catalog manager: success
I20261120 09:03:37.106779 25705 catalog_manager.cc:1653] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20261120 09:03:37.192329 24854 heartbeater.cc:345] Connected to a master server at 127.23.79.124:33881
I20261120 09:03:37.196208 25650 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" instance_seqno: 1795165402395308) as {username='slave'} at 127.23.79.67:54453; Asking this server to re-register.
I20261120 09:03:37.196888 24562 heartbeater.cc:345] Connected to a master server at 127.23.79.124:33881
I20261120 09:03:37.197055 24854 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:37.198572 25650 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" instance_seqno: 1795165401200304) as {username='slave'} at 127.23.79.65:36109; Asking this server to re-register.
I20261120 09:03:37.199445 24562 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:37.200392 25650 ts_manager.cc:210] Registered new tserver with Master: 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:37.201351 24707 heartbeater.cc:345] Connected to a master server at 127.23.79.124:33881
I20261120 09:03:37.201419 25649 ts_manager.cc:210] Registered new tserver with Master: 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:37.203150 25649 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" instance_seqno: 1795165401905746) as {username='slave'} at 127.23.79.66:36889; Asking this server to re-register.
I20261120 09:03:37.203754 24707 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:37.205422 25649 ts_manager.cc:210] Registered new tserver with Master: 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879)
I20261120 09:03:37.577276 25691 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:37.577519 25691 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:37.579409 25691 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:03:37.580114 25636 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:03:37.581544 25636 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:03:37.581797 25637 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
I20261120 09:03:37.581887 25637 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:03:37.582190 25691 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20261120 09:03:38.175062 25720 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:38.175261 25720 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:38.176049 25720 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:03:38.177870 25637 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:03:38.178115 25636 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:03:38.178217 25636 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:03:38.178437 25720 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20261120 09:03:39.114030 25732 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:39.114261 25732 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:39.114944 25732 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:03:39.117103 25637 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:03:39.117343 25636 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:03:39.117470 25636 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:03:39.117749 25732 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20261120 09:03:39.175200 25290 raft_consensus.cc:534] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:39.175434 25290 raft_consensus.cc:556] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:39.176421 25290 leader_election.cc:290] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
W20261120 09:03:39.177196 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
W20261120 09:03:39.177368 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:03:39.177433 24595 leader_election.cc:304] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:03:39.177670 25736 raft_consensus.cc:2966] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:03:39.851346 23869 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu
/tmp/dist-test-taskH9EWc6/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.79.126:41659
--webserver_interface=127.23.79.126
--webserver_port=33973
--builtin_ntp_servers=127.23.79.84:36147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881
--hive_metastore_uris=thrift://127.0.0.1:38755
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20261120 09:03:40.033372 25742 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:40.033595 25742 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:40.034389 25742 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:03:40.044472 25637 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:03:40.044857 25636 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:03:40.045042 25636 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:03:40.045359 25742 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20261120 09:03:40.191676 25741 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261120 09:03:40.192029 25741 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261120 09:03:40.192162 25741 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261120 09:03:40.200124 25741 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20261120 09:03:40.200240 25741 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261120 09:03:40.200361 25741 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20261120 09:03:40.200445 25741 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20261120 09:03:40.209923 25741 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.79.84:36147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:38755
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.79.126:41659
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.79.126
--webserver_port=33973
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 36b6772d828145f8fbba3c49746c86838683f9ba
build type FASTDEBUG
built by None at 20 Nov 2026 08:44:26 UTC on bdcb31816ec0
build id 14873
ASAN enabled
I20261120 09:03:40.211652 25741 env_posix.cc:2337] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261120 09:03:40.213290 25741 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261120 09:03:40.221884 25753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261120 09:03:40.222939 25756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261120 09:03:40.223138 25754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261120 09:03:40.224205 25741 server_base.cc:1061] running on GCE node
I20261120 09:03:40.224946 25741 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261120 09:03:40.226498 25741 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261120 09:03:40.227739 25741 hybrid_clock.cc:648] HybridClock initialized: now 1795165420227697 us; error 30 us; skew 500 ppm
I20261120 09:03:40.228132 25741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261120 09:03:40.230835 25741 webserver.cc:577] Webserver started at http://127.23.79.126:33973/ using document root <none> and password file <none>
I20261120 09:03:40.231738 25741 fs_manager.cc:362] Metadata directory not provided
I20261120 09:03:40.231851 25741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261120 09:03:40.238224 25741 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.002s	sys 0.004s
I20261120 09:03:40.241053 25762 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261120 09:03:40.242656 25741 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20261120 09:03:40.242810 25741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data,/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/wal
uuid: "a99947e985094a3e8999fe2aa4e23f18"
format_stamp: "Formatted at 2026-11-20 09:03:19 on dist-test-slave-vzd6"
I20261120 09:03:40.243661 25741 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261120 09:03:40.268858 25741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261120 09:03:40.269690 25741 env_posix.cc:2337] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261120 09:03:40.269953 25741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261120 09:03:40.291684 25741 rpc_server.cc:307] RPC server started. Bound to: 127.23.79.126:41659
I20261120 09:03:40.291702 25813 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.79.126:41659 every 8 connection(s)
I20261120 09:03:40.293592 25741 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data/info.pb
I20261120 09:03:40.298781 23869 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu as pid 25741
I20261120 09:03:40.302219 25814 sys_catalog.cc:263] Verifying existing consensus state
I20261120 09:03:40.306463 25814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: Bootstrap starting.
I20261120 09:03:40.323734 25814 log.cc:826] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: Log is configured to *not* fsync() on all Append() calls
I20261120 09:03:40.391469 25814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: Bootstrap replayed 1/1 log segments. Stats: ops{read=84 overwritten=0 applied=84 ignored=0} inserts{seen=62 ignored=0} mutations{seen=70 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261120 09:03:40.392036 25814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: Bootstrap complete.
I20261120 09:03:40.397325 25814 raft_consensus.cc:366] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:40.397939 25814 raft_consensus.cc:787] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99947e985094a3e8999fe2aa4e23f18, State: Initialized, Role: FOLLOWER
I20261120 09:03:40.398605 25814 consensus_queue.cc:261] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 84, Last appended: 4.84, Last appended by leader: 84, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:40.399360 25818 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:40.399633 25818 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:40.400518 25814 sys_catalog.cc:565] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: configured and running, proceeding with master startup.
I20261120 09:03:40.432332 25832 catalog_manager.cc:1310] Loaded cluster ID: b96ccaeeefb845f4962e35569b62531b
I20261120 09:03:40.432547 25832 catalog_manager.cc:1603] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: loading cluster ID for follower catalog manager: success
I20261120 09:03:40.437506 25832 catalog_manager.cc:1625] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: acquiring CA information for follower catalog manager: success
I20261120 09:03:40.441381 25832 catalog_manager.cc:1653] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20261120 09:03:40.439581 25741 master_runner.cc:187] Error getting master registration for 127.23.79.125:45319: Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111), 
I20261120 09:03:40.444917 25741 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:03:40.523160 24568 heartbeater.cc:345] Connected to a master server at 127.23.79.126:41659
I20261120 09:03:40.527191 25779 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" instance_seqno: 1795165401200304) as {username='slave'} at 127.23.79.65:44657; Asking this server to re-register.
I20261120 09:03:40.527992 24568 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:40.529740 25779 ts_manager.cc:210] Registered new tserver with Master: 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:40.551065 24708 heartbeater.cc:345] Connected to a master server at 127.23.79.126:41659
I20261120 09:03:40.553928 25778 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" instance_seqno: 1795165401905746) as {username='slave'} at 127.23.79.66:44625; Asking this server to re-register.
I20261120 09:03:40.554956 24708 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:40.556901 25778 ts_manager.cc:210] Registered new tserver with Master: 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879)
I20261120 09:03:40.569327 24855 heartbeater.cc:345] Connected to a master server at 127.23.79.126:41659
I20261120 09:03:40.571417 25779 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" instance_seqno: 1795165402395308) as {username='slave'} at 127.23.79.67:42459; Asking this server to re-register.
I20261120 09:03:40.572065 24855 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:40.573426 25779 ts_manager.cc:210] Registered new tserver with Master: 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:40.962918 25839 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:40.963121 25839 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:40.963928 25839 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:03:40.966578 25636 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:03:40.970167 25789 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d82bf27d60fa450e8f941d1a9d36a825" candidate_term: 7 candidate_status { last_received { term: 6 index: 85 } } ignore_live_leader: false dest_uuid: "a99947e985094a3e8999fe2aa4e23f18" is_pre_election: true
I20261120 09:03:40.970723 25789 raft_consensus.cc:2062] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 4 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate d82bf27d60fa450e8f941d1a9d36a825 in term 4
I20261120 09:03:40.971380 25637 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99947e985094a3e8999fe2aa4e23f18, d82bf27d60fa450e8f941d1a9d36a825; no voters: d2b1940991ac40bd916579d581e689f4
I20261120 09:03:40.971695 25839 raft_consensus.cc:3024] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20261120 09:03:40.971833 25839 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261120 09:03:40.971966 25839 raft_consensus.cc:3296] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 6 FOLLOWER]: Advancing to term 7
I20261120 09:03:40.972571 25839 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:40.976616 25839 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 election: Requested vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
I20261120 09:03:40.976981 25789 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d82bf27d60fa450e8f941d1a9d36a825" candidate_term: 7 candidate_status { last_received { term: 6 index: 85 } } ignore_live_leader: false dest_uuid: "a99947e985094a3e8999fe2aa4e23f18"
I20261120 09:03:40.977172 25789 raft_consensus.cc:3296] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 4 FOLLOWER]: Advancing to term 7
I20261120 09:03:40.977952 25789 raft_consensus.cc:2062] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Leader election vote request: granting yes vote for candidate d82bf27d60fa450e8f941d1a9d36a825 in term 7
W20261120 09:03:40.978571 25636 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:03:40.981849 25637 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99947e985094a3e8999fe2aa4e23f18, d82bf27d60fa450e8f941d1a9d36a825; no voters: d2b1940991ac40bd916579d581e689f4
I20261120 09:03:40.982134 25839 raft_consensus.cc:3024] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 7 FOLLOWER]: Leader election won for term 7
I20261120 09:03:40.982342 25839 raft_consensus.cc:744] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 7 LEADER]: Becoming Leader. State: Replica: d82bf27d60fa450e8f941d1a9d36a825, State: Running, Role: LEADER
I20261120 09:03:40.982820 25839 consensus_queue.cc:238] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 85, Committed index: 85, Last appended: 6.85, Last appended by leader: 85, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:40.985373 25843 sys_catalog.cc:455] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d82bf27d60fa450e8f941d1a9d36a825. Latest consensus state: current_term: 7 leader_uuid: "d82bf27d60fa450e8f941d1a9d36a825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:40.986865 25843 sys_catalog.cc:458] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: This master's current role is: LEADER
I20261120 09:03:40.986967 25789 raft_consensus.cc:1338] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Refusing update from remote peer d82bf27d60fa450e8f941d1a9d36a825: Log matching property violated. Preceding OpId in replica: term: 4 index: 84. Preceding OpId from leader: term: 7 index: 86. (index mismatch)
W20261120 09:03:40.987375 25636 consensus_peers.cc:597] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 -> Peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Couldn't send request to peer d2b1940991ac40bd916579d581e689f4. Status: Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20261120 09:03:40.988005 25839 consensus_queue.cc:1049] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 86, Last known committed idx: 84, Time since last communication: 0.000s
I20261120 09:03:40.988523 25848 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261120 09:03:40.991592 25851 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "d82bf27d60fa450e8f941d1a9d36a825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:40.991770 25848 catalog_manager.cc:694] Loaded metadata for table default.table_797fe36dbbf14c0c8e085d8470e75a24 [id=07e09703ed284b73a0c9915d40065e82]
I20261120 09:03:40.991855 25851 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:40.992384 25848 catalog_manager.cc:694] Loaded metadata for table default.table_5b01ae1724c5451c8ac9c936c5c8c983 [id=0bfc8c6dc2e94a92b142bee12f2b88e8]
I20261120 09:03:40.992385 25844 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d82bf27d60fa450e8f941d1a9d36a825. Latest consensus state: current_term: 7 leader_uuid: "d82bf27d60fa450e8f941d1a9d36a825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:40.992574 25844 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:40.992864 25848 catalog_manager.cc:694] Loaded metadata for table default.table_4a315c29012549dcab8e1d9373f99f30 [id=1513ff7b0a7c4bcb9127e67296a844c5]
I20261120 09:03:40.993350 25848 catalog_manager.cc:694] Loaded metadata for table default.table_b2351eb1045a47feb0ca7b7422706581 [id=268c82ae3c7448059e7674f73aad3114]
I20261120 09:03:40.993597 25839 sys_catalog.cc:455] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 7 leader_uuid: "d82bf27d60fa450e8f941d1a9d36a825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:40.993836 25839 sys_catalog.cc:458] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: This master's current role is: LEADER
I20261120 09:03:40.994021 25848 catalog_manager.cc:694] Loaded metadata for table default.table_f9f890b63b384c3b9f30da0ba8a80c03 [id=315bdedf9fe44e5d866534884f65f6d4]
I20261120 09:03:40.994012 25844 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "d82bf27d60fa450e8f941d1a9d36a825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:40.994194 25844 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:40.994735 25848 catalog_manager.cc:694] Loaded metadata for table default.table_6a2be3a544144a99b0f343bca3024912 [id=35553b36397740a29f2588fd2a840c61]
I20261120 09:03:40.995082 25848 catalog_manager.cc:694] Loaded metadata for table default.table_b329d3b2bb9a409b9290011073304555 [id=3f913310fd9a49b6b264540325c0139e]
I20261120 09:03:40.995438 25848 catalog_manager.cc:694] Loaded metadata for table default.table_414553f5c3994f4097d7fdbf9dc01082 [id=55152bf51e49475ea6391839e6630cd0]
I20261120 09:03:40.995867 25848 catalog_manager.cc:694] Loaded metadata for table default.table_f0940064a6844fdaadb8859f4257b11f [id=6a7afe82b2724dccb508eb95158c7ec7]
I20261120 09:03:40.996243 25848 catalog_manager.cc:694] Loaded metadata for table default.table_67a0134c1cdf49a49bea9d4b2818b558 [id=7510ae7af246485ca9d5b539b3f90bbb]
I20261120 09:03:40.996661 25848 catalog_manager.cc:694] Loaded metadata for table default.table_0d4b09a9b1754e38bca62e97c14a0854 [id=83bafe99e25046a4a43a3739a3ca07a1]
I20261120 09:03:40.997021 25848 catalog_manager.cc:694] Loaded metadata for table default.table_5f2e35d59fff4bc89139835f148d0414 [id=86b210ad5a5d4f66ad1c8da6ec85dc53]
I20261120 09:03:40.997370 25848 catalog_manager.cc:694] Loaded metadata for table default.table_4d5337371cd3454fa5aae228272e5fda [id=90570e46cebe47eba97e5b980f23e909]
I20261120 09:03:40.997699 25848 catalog_manager.cc:694] Loaded metadata for table default.table_d68821f474e040e18b4d91fbbd850863 [id=9d133f08f71d42b89628f2869cbaa424]
I20261120 09:03:40.998019 25848 catalog_manager.cc:694] Loaded metadata for table default.table_784f78c485a74606a638a81633a149e7 [id=aa6cfb171b4c482caa17d7c0862da3d0]
I20261120 09:03:40.998416 25848 catalog_manager.cc:694] Loaded metadata for table default.table_c622167e221c4db9953d7a278bd41411 [id=b21dc844213f4fc8b0f28c935f221a1b]
I20261120 09:03:40.998759 25848 catalog_manager.cc:694] Loaded metadata for table default.table_39131cc9c462405ba3639c841ebfe256 [id=cb55967ea90e43be8da1354763f7984c]
I20261120 09:03:40.999089 25848 catalog_manager.cc:694] Loaded metadata for table default.table_1a335d2b826a4f21a34ac38ad85ff200 [id=d16648dc14594d6db8143aaa02f420a5]
I20261120 09:03:40.999395 25848 catalog_manager.cc:694] Loaded metadata for table default.table_d67fc59080cc4194b566604a649aefad [id=ec464d0cd5ec4ec2bc03ebb8a14481e0]
I20261120 09:03:41.001907 25848 tablet_loader.cc:96] loaded metadata for tablet 0bac0a6b89f34c549c5118605ed0acbf (table default.table_414553f5c3994f4097d7fdbf9dc01082 [id=55152bf51e49475ea6391839e6630cd0])
I20261120 09:03:41.002278 25848 tablet_loader.cc:96] loaded metadata for tablet 18019fa55aae42be8fb9e5421dd45630 (table default.table_0d4b09a9b1754e38bca62e97c14a0854 [id=83bafe99e25046a4a43a3739a3ca07a1])
I20261120 09:03:41.002678 25848 tablet_loader.cc:96] loaded metadata for tablet 212960af80bf45deb7c508c3356d3391 (table default.table_c622167e221c4db9953d7a278bd41411 [id=b21dc844213f4fc8b0f28c935f221a1b])
I20261120 09:03:41.003029 25848 tablet_loader.cc:96] loaded metadata for tablet 26f97270103e4956b82be66244c71301 (table default.table_39131cc9c462405ba3639c841ebfe256 [id=cb55967ea90e43be8da1354763f7984c])
I20261120 09:03:41.003430 25848 tablet_loader.cc:96] loaded metadata for tablet 2ee53da425f54c4aaed62a9211d5c2f9 (table default.table_5b01ae1724c5451c8ac9c936c5c8c983 [id=0bfc8c6dc2e94a92b142bee12f2b88e8])
I20261120 09:03:41.003892 25848 tablet_loader.cc:96] loaded metadata for tablet 32a60fc620aa4027b4653877225c0604 (table default.table_5f2e35d59fff4bc89139835f148d0414 [id=86b210ad5a5d4f66ad1c8da6ec85dc53])
I20261120 09:03:41.004324 25848 tablet_loader.cc:96] loaded metadata for tablet 5276bce755e042379220edc02e7b8f09 (table default.table_6a2be3a544144a99b0f343bca3024912 [id=35553b36397740a29f2588fd2a840c61])
I20261120 09:03:41.004748 25848 tablet_loader.cc:96] loaded metadata for tablet 565df75f345947bea84b343c454ea1be (table default.table_1a335d2b826a4f21a34ac38ad85ff200 [id=d16648dc14594d6db8143aaa02f420a5])
I20261120 09:03:41.005081 25848 tablet_loader.cc:96] loaded metadata for tablet 6130d88766ca4ced867fb83be00a00f5 (table default.table_67a0134c1cdf49a49bea9d4b2818b558 [id=7510ae7af246485ca9d5b539b3f90bbb])
I20261120 09:03:41.005566 25848 tablet_loader.cc:96] loaded metadata for tablet 707757cc32af4fe98d4a04e6a7498c17 (table default.table_4d5337371cd3454fa5aae228272e5fda [id=90570e46cebe47eba97e5b980f23e909])
I20261120 09:03:41.005894 25848 tablet_loader.cc:96] loaded metadata for tablet 75e156478a8a470ba5f4942cd8e6a89e (table default.table_f9f890b63b384c3b9f30da0ba8a80c03 [id=315bdedf9fe44e5d866534884f65f6d4])
I20261120 09:03:41.006230 25848 tablet_loader.cc:96] loaded metadata for tablet 8155295b7e8e40ddaedeb2e9c24f1245 (table default.table_b2351eb1045a47feb0ca7b7422706581 [id=268c82ae3c7448059e7674f73aad3114])
I20261120 09:03:41.006805 25848 tablet_loader.cc:96] loaded metadata for tablet a27e6c05e40742d4ab0116c2e22cd4ba (table default.table_784f78c485a74606a638a81633a149e7 [id=aa6cfb171b4c482caa17d7c0862da3d0])
I20261120 09:03:41.007125 25848 tablet_loader.cc:96] loaded metadata for tablet a48b8166531548208bf3ae77f7380555 (table default.table_d67fc59080cc4194b566604a649aefad [id=ec464d0cd5ec4ec2bc03ebb8a14481e0])
I20261120 09:03:41.007889 25848 tablet_loader.cc:96] loaded metadata for tablet ab6cc162ae404f91a484d70756e3897f (table default.table_b329d3b2bb9a409b9290011073304555 [id=3f913310fd9a49b6b264540325c0139e])
I20261120 09:03:41.008801 25848 tablet_loader.cc:96] loaded metadata for tablet bf5c1cdd4f5c4ce6b89f099b65629910 (table default.table_797fe36dbbf14c0c8e085d8470e75a24 [id=07e09703ed284b73a0c9915d40065e82])
I20261120 09:03:41.009268 25848 tablet_loader.cc:96] loaded metadata for tablet cb09ac7d6f3c42a6b5f7cf5a900f177f (table default.table_4a315c29012549dcab8e1d9373f99f30 [id=1513ff7b0a7c4bcb9127e67296a844c5])
I20261120 09:03:41.009769 25848 tablet_loader.cc:96] loaded metadata for tablet e4979050b3154c6292e42c8a3f7c89e7 (table default.table_f0940064a6844fdaadb8859f4257b11f [id=6a7afe82b2724dccb508eb95158c7ec7])
I20261120 09:03:41.010008 25848 tablet_loader.cc:96] loaded metadata for tablet e7f41973f62a48cf8b20ec4d965bfa6e (table default.table_d68821f474e040e18b4d91fbbd850863 [id=9d133f08f71d42b89628f2869cbaa424])
I20261120 09:03:41.010409 25848 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261120 09:03:41.011636 25848 catalog_manager.cc:1310] Loaded cluster ID: b96ccaeeefb845f4962e35569b62531b
I20261120 09:03:41.011714 25848 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261120 09:03:41.013063 25848 catalog_manager.cc:1555] Loading token signing keys...
I20261120 09:03:41.014452 25848 catalog_manager.cc:6248] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: Loaded TSK: 0
I20261120 09:03:41.015429 25848 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261120 09:03:41.016474 25848 catalog_manager.cc:1578] Loading latest processed Hive Metastore notification log event ID...
I20261120 09:03:41.017673 25848 catalog_manager.cc:6086] Last processed Hive Metastore notification event ID: 21
F20261120 09:03:41.098472 25704 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 26, previous 26; dumping first 6 out of 15 received events: NotificationEvent(eventId=22, eventTime=1795165406, eventType=CREATE_TABLE, dbName=default, tableName=table_c622167e221c4db9953d7a278bd41411, message={"server":"","servicePrincipal":"","db":"default","table":"table_c622167e221c4db9953d7a278bd41411","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_c622167e221c4db9953d7a278bd41411\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1795165406},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/warehouse/table_c622167e221c4db9953d7a278bd41411\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_c622167e221c4db9953d7a278bd41411\",\"kudu.table_id\":\"b21dc844213f4fc8b0f28c935f221a1b\",\"transient_lastDdlTime\":\"1795165406\",\"comment\":\"\",\"kudu.master_addresses\":\"127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"b96ccaeeefb845f4962e35569b62531b\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1795165406,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1795165406, eventType=DROP_TABLE, dbName=default, tableName=table_d68821f474e040e18b4d91fbbd850863, message={"server":"","servicePrincipal":"","db":"default","table":"table_d68821f474e040e18b4d91fbbd850863","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_d68821f474e040e18b4d91fbbd850863\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1795165403},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/warehouse/table_d68821f474e040e18b4d91fbbd850863\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_d68821f474e040e18b4d91fbbd850863\",\"kudu.table_id\":\"9d133f08f71d42b89628f2869cbaa424\",\"transient_lastDdlTime\":\"1795165403\",\"comment\":\"\",\"kudu.master_addresses\":\"127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"b96ccaeeefb845f4962e35569b62531b\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1795165406}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=24, eventTime=1795165407, eventType=ALTER_TABLE, dbName=default, tableName=table_a63a3233f7d94bf99010f9b0c7cb365e, message={"server":"","servicePrincipal":"","db":"default","table":"table_39131cc9c462405ba3639c841ebfe256","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_39131cc9c462405ba3639c841ebfe256\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1795165402},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/warehouse/table_39131cc9c462405ba3639c841ebfe256\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_39131cc9c462405ba3639c841ebfe256\",\"kudu.table_id\":\"cb55967ea90e43be8da1354763f7984c\",\"transient_lastDdlTime\":\"1795165402\",\"comment\":\"\",\"kudu.master_addresses\":\"127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"b96ccaeeefb845f4962e35569b62531b\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_a63a3233f7d94bf99010f9b0c7cb365e\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1795165402},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/warehouse/table_a63a3233f7d94bf99010f9b0c7cb365e\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a63a3233f7d94bf99010f9b0c7cb365e\",\"kudu.table_id\":\"cb55967ea90e43be8da1354763f7984c\",\"transient_lastDdlTime\":\"1795165402\",\"comment\":\"\",\"kudu.master_addresses\":\"127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"b96ccaeeefb845f4962e35569b62531b\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1795165407}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=25, eventTime=1795165407, eventType=DROP_TABLE, dbName=default, tableName=table_d67fc59080cc4194b566604a649aefad, message={"server":"","servicePrincipal":"","db":"default","table":"table_d67fc59080cc4194b566604a649aefad","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_d67fc59080cc4194b566604a649aefad\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1795165403},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/warehouse/table_d67fc59080cc4194b566604a649aefad\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_d67fc59080cc4194b566604a649aefad\",\"kudu.table_id\":\"ec464d0cd5ec4ec2bc03ebb8a14481e0\",\"transient_lastDdlTime\":\"1795165403\",\"comment\":\"\",\"kudu.master_addresses\":\"127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"b96ccaeeefb845f4962e35569b62531b\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1795165407}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=26, eventTime=1795165407, eventType=CREATE_TABLE, dbName=default, tableName=table_414553f5c3994f4097d7fdbf9dc01082, message={"server":"","servicePrincipal":"","db":"default","table":"table_414553f5c3994f4097d7fdbf9dc01082","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_414553f5c3994f4097d7fdbf9dc01082\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1795165407},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/warehouse/table_414553f5c3994f4097d7fdbf9dc01082\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_414553f5c3994f4097d7fdbf9dc01082\",\"kudu.table_id\":\"55152bf51e49475ea6391839e6630cd0\",\"transient_lastDdlTime\":\"1795165407\",\"comment\":\"\",\"kudu.master_addresses\":\"127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"b96ccaeeefb845f4962e35569b62531b\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1795165407,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=26, eventTime=1795165407, eventType=CREATE_TABLE, dbName=default, tableName=table_ebc744ebb12d4dd498ca3721c3b9ac6a, message={"server":"","servicePrincipal":"","db":"default","table":"table_ebc744ebb12d4dd498ca3721c3b9ac6a","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_ebc744ebb12d4dd498ca3721c3b9ac6a\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1795165407},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/warehouse/table_ebc744ebb12d4dd498ca3721c3b9ac6a\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_ebc744ebb12d4dd498ca3721c3b9ac6a\",\"kudu.table_id\":\"30da2006c3bb45c2b945f08d7cbe6945\",\"transient_lastDdlTime\":\"1795165407\",\"comment\":\"\",\"kudu.master_addresses\":\"127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"b96ccaeeefb845f4962e35569b62531b\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1795165407,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
    @     0x7fca6806cd5d  google::LogMessage::Fail() at ??:0
    @     0x7fca68070b23  google::LogMessage::SendToLog() at ??:0
    @     0x7fca6806c75c  google::LogMessage::Flush() at ??:0
    @     0x7fca6806c9a1  google::LogMessage::~LogMessage() at ??:0
    @     0x7fca7d53c3f4  kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
    @     0x7fca7d53aca1  kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
    @     0x7fca7d54291c  kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
    @     0x7fca7d542799  std::_Function_handler<>::_M_invoke() at ??:0
    @           0x372c7d  std::function<>::operator()() at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/../sanitizer_common/sanitizer_common_interceptors.inc:5196
    @     0x7fca694b6dd9  kudu::Thread::SuperviseThread() at ??:0
    @     0x7fca6cb9f6db  start_thread at ??:0
    @     0x7fca6560061f  clone at ??:0
W20261120 09:03:41.301044 24595 connection.cc:573] client connection to 127.23.79.124:33881 recv error: Network error: recv error from unknown peer: Connection reset by peer (error 104)
W20261120 09:03:41.301451 24742 connection.cc:573] client connection to 127.23.79.124:33881 recv error: Network error: recv error from unknown peer: Connection reset by peer (error 104)
W20261120 09:03:41.302026 24861 connection.cc:573] client connection to 127.23.79.124:33881 recv error: Network error: recv error from unknown peer: Connection reset by peer (error 104)
W20261120 09:03:41.302639 24443 connection.cc:573] client connection to 127.23.79.124:33881 recv error: Network error: recv error from unknown peer: Connection reset by peer (error 104)
I20261120 09:03:41.493942 25844 raft_consensus.cc:534] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d82bf27d60fa450e8f941d1a9d36a825)
I20261120 09:03:41.494176 25844 raft_consensus.cc:556] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:41.496193 25844 leader_election.cc:290] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319), d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881)
W20261120 09:03:41.497284 25765 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:03:41.498560 25763 leader_election.cc:336] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881): Network error: Client connection negotiation failed: client connection to 127.23.79.124:33881: connect: Connection refused (error 111)
W20261120 09:03:41.498770 25765 leader_election.cc:336] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:03:41.498956 25765 leader_election.cc:304] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99947e985094a3e8999fe2aa4e23f18; no voters: d2b1940991ac40bd916579d581e689f4, d82bf27d60fa450e8f941d1a9d36a825
I20261120 09:03:41.499276 25844 raft_consensus.cc:2966] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20261120 09:03:42.028385 25871 raft_consensus.cc:534] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d82bf27d60fa450e8f941d1a9d36a825)
I20261120 09:03:42.028630 25871 raft_consensus.cc:556] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:42.029379 25871 leader_election.cc:290] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319), d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881)
W20261120 09:03:42.031558 25765 leader_election.cc:336] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:03:42.031800 25763 leader_election.cc:336] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881): Network error: Client connection negotiation failed: client connection to 127.23.79.124:33881: connect: Connection refused (error 111)
I20261120 09:03:42.031924 25763 leader_election.cc:304] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99947e985094a3e8999fe2aa4e23f18; no voters: d2b1940991ac40bd916579d581e689f4, d82bf27d60fa450e8f941d1a9d36a825
I20261120 09:03:42.032181 25871 raft_consensus.cc:2966] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20261120 09:03:42.593952 23869 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu pid 25741
I20261120 09:03:42.598271 25736 raft_consensus.cc:534] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:42.598547 25736 raft_consensus.cc:556] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:42.599290 25736 leader_election.cc:290] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
W20261120 09:03:42.600050 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
W20261120 09:03:42.600381 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:03:42.600507 24595 leader_election.cc:304] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:03:42.600807 25736 raft_consensus.cc:2966] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:03:42.607911 25809 generic_service.cc:196] Checking for leaks (request via RPC)
I20261120 09:03:42.713740 23869 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu with pid 25741
I20261120 09:03:43.382897 23869 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu
/tmp/dist-test-taskH9EWc6/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.79.126:41659
--webserver_interface=127.23.79.126
--webserver_port=33973
--builtin_ntp_servers=127.23.79.84:36147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881
--hive_metastore_uris=thrift://127.0.0.1:38755
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20261120 09:03:43.734740 25880 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261120 09:03:43.735072 25880 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261120 09:03:43.735219 25880 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261120 09:03:43.743052 25880 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20261120 09:03:43.743168 25880 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261120 09:03:43.743291 25880 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20261120 09:03:43.743372 25880 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20261120 09:03:43.753197 25880 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.79.84:36147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:38755
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.79.126:41659
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.79.126
--webserver_port=33973
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 36b6772d828145f8fbba3c49746c86838683f9ba
build type FASTDEBUG
built by None at 20 Nov 2026 08:44:26 UTC on bdcb31816ec0
build id 14873
ASAN enabled
I20261120 09:03:43.754962 25880 env_posix.cc:2337] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261120 09:03:43.756721 25880 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261120 09:03:43.764822 25886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261120 09:03:43.764822 25885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261120 09:03:43.765729 25888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261120 09:03:43.766223 25880 server_base.cc:1061] running on GCE node
I20261120 09:03:43.767192 25880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261120 09:03:43.769363 25880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261120 09:03:43.770640 25880 hybrid_clock.cc:648] HybridClock initialized: now 1795165423770569 us; error 40 us; skew 500 ppm
I20261120 09:03:43.770972 25880 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261120 09:03:43.773115 25880 webserver.cc:577] Webserver started at http://127.23.79.126:33973/ using document root <none> and password file <none>
I20261120 09:03:43.773828 25880 fs_manager.cc:362] Metadata directory not provided
I20261120 09:03:43.773955 25880 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261120 09:03:43.779275 25880 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.000s	sys 0.003s
I20261120 09:03:43.781997 25894 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261120 09:03:43.783375 25880 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20261120 09:03:43.783541 25880 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data,/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/wal
uuid: "a99947e985094a3e8999fe2aa4e23f18"
format_stamp: "Formatted at 2026-11-20 09:03:19 on dist-test-slave-vzd6"
I20261120 09:03:43.784155 25880 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261120 09:03:43.798334 25880 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261120 09:03:43.799114 25880 env_posix.cc:2337] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261120 09:03:43.799407 25880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261120 09:03:43.819644 25880 rpc_server.cc:307] RPC server started. Bound to: 127.23.79.126:41659
I20261120 09:03:43.819669 25945 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.79.126:41659 every 8 connection(s)
I20261120 09:03:43.821256 25880 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data/info.pb
I20261120 09:03:43.828007 25946 sys_catalog.cc:263] Verifying existing consensus state
I20261120 09:03:43.830765 23869 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu as pid 25880
I20261120 09:03:43.831815 25946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: Bootstrap starting.
I20261120 09:03:43.849521 25946 log.cc:826] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: Log is configured to *not* fsync() on all Append() calls
I20261120 09:03:43.911834 25946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: Bootstrap replayed 1/1 log segments. Stats: ops{read=86 overwritten=0 applied=86 ignored=0} inserts{seen=62 ignored=0} mutations{seen=70 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261120 09:03:43.912492 25946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: Bootstrap complete.
I20261120 09:03:43.917973 25946 raft_consensus.cc:366] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:43.918673 25946 raft_consensus.cc:787] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99947e985094a3e8999fe2aa4e23f18, State: Initialized, Role: FOLLOWER
I20261120 09:03:43.919296 25946 consensus_queue.cc:261] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 86, Last appended: 7.86, Last appended by leader: 86, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:43.920051 25950 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:43.920310 25950 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:43.921082 25946 sys_catalog.cc:565] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: configured and running, proceeding with master startup.
I20261120 09:03:43.946797 25964 catalog_manager.cc:1310] Loaded cluster ID: b96ccaeeefb845f4962e35569b62531b
I20261120 09:03:43.948670 25964 catalog_manager.cc:1603] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: loading cluster ID for follower catalog manager: success
I20261120 09:03:43.953594 25964 catalog_manager.cc:1625] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: acquiring CA information for follower catalog manager: success
I20261120 09:03:43.957190 25964 catalog_manager.cc:1653] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20261120 09:03:43.953073 25880 master_runner.cc:187] Error getting master registration for 127.23.79.125:45319: Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111), 
I20261120 09:03:43.958952 25880 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:03:44.051507 24568 heartbeater.cc:345] Connected to a master server at 127.23.79.126:41659
I20261120 09:03:44.054718 25911 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" instance_seqno: 1795165401200304) as {username='slave'} at 127.23.79.65:56097; Asking this server to re-register.
I20261120 09:03:44.055441 24568 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:44.057291 25911 ts_manager.cc:210] Registered new tserver with Master: 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:44.080082 24708 heartbeater.cc:345] Connected to a master server at 127.23.79.126:41659
I20261120 09:03:44.082101 25911 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" instance_seqno: 1795165401905746) as {username='slave'} at 127.23.79.66:47261; Asking this server to re-register.
I20261120 09:03:44.082844 24708 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:44.085021 25911 ts_manager.cc:210] Registered new tserver with Master: 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879)
I20261120 09:03:44.099200 24855 heartbeater.cc:345] Connected to a master server at 127.23.79.126:41659
I20261120 09:03:44.101344 25911 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" instance_seqno: 1795165402395308) as {username='slave'} at 127.23.79.67:42677; Asking this server to re-register.
I20261120 09:03:44.102079 24855 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:44.103745 25911 ts_manager.cc:210] Registered new tserver with Master: 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:44.509166 25968 raft_consensus.cc:534] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:44.509467 25968 raft_consensus.cc:556] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:44.511443 25968 leader_election.cc:290] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319), d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881)
W20261120 09:03:44.512591 25897 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:03:44.513907 25895 leader_election.cc:336] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881): Network error: Client connection negotiation failed: client connection to 127.23.79.124:33881: connect: Connection refused (error 111)
W20261120 09:03:44.514115 25897 leader_election.cc:336] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:03:44.514364 25897 leader_election.cc:304] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99947e985094a3e8999fe2aa4e23f18; no voters: d2b1940991ac40bd916579d581e689f4, d82bf27d60fa450e8f941d1a9d36a825
I20261120 09:03:44.514734 25968 raft_consensus.cc:2966] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20261120 09:03:45.211834 25972 raft_consensus.cc:534] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:45.212025 25972 raft_consensus.cc:556] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:45.212713 25972 leader_election.cc:290] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319), d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881)
W20261120 09:03:45.214759 25897 leader_election.cc:336] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:03:45.214962 25895 leader_election.cc:336] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881): Network error: Client connection negotiation failed: client connection to 127.23.79.124:33881: connect: Connection refused (error 111)
I20261120 09:03:45.215107 25895 leader_election.cc:304] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99947e985094a3e8999fe2aa4e23f18; no voters: d2b1940991ac40bd916579d581e689f4, d82bf27d60fa450e8f941d1a9d36a825
I20261120 09:03:45.215343 25972 raft_consensus.cc:2966] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20261120 09:03:46.132464 25977 raft_consensus.cc:534] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:46.132673 25977 raft_consensus.cc:556] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:46.133447 25977 leader_election.cc:290] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319), d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881)
W20261120 09:03:46.135488 25897 leader_election.cc:336] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:03:46.135727 25895 leader_election.cc:336] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881): Network error: Client connection negotiation failed: client connection to 127.23.79.124:33881: connect: Connection refused (error 111)
I20261120 09:03:46.135905 25895 leader_election.cc:304] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99947e985094a3e8999fe2aa4e23f18; no voters: d2b1940991ac40bd916579d581e689f4, d82bf27d60fa450e8f941d1a9d36a825
I20261120 09:03:46.136222 25977 raft_consensus.cc:2966] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20261120 09:03:46.155134 23869 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu pid 25880
I20261120 09:03:46.161744 25941 generic_service.cc:196] Checking for leaks (request via RPC)
I20261120 09:03:46.275095 23869 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu with pid 25880
W20261120 09:03:46.294518 24864 connection.cc:573] client connection to 127.23.79.126:41659 recv error: Network error: recv error from unknown peer: Connection reset by peer (error 104)
I20261120 09:03:46.892661 25976 raft_consensus.cc:534] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:46.892877 25976 raft_consensus.cc:556] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:03:46.893527 25976 leader_election.cc:290] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
W20261120 09:03:46.894376 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
W20261120 09:03:46.894672 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:03:46.894821 24595 leader_election.cc:304] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:03:46.895149 25976 raft_consensus.cc:2966] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:03:47.161365 23869 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu
/tmp/dist-test-taskH9EWc6/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.79.126:41659
--webserver_interface=127.23.79.126
--webserver_port=33973
--builtin_ntp_servers=127.23.79.84:36147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881
--hive_metastore_uris=thrift://127.0.0.1:38755
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20261120 09:03:47.490880 25986 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261120 09:03:47.491212 25986 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261120 09:03:47.491353 25986 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261120 09:03:47.499024 25986 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20261120 09:03:47.499132 25986 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261120 09:03:47.499246 25986 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20261120 09:03:47.499331 25986 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20261120 09:03:47.509179 25986 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.79.84:36147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:38755
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.79.126:41659
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.79.126
--webserver_port=33973
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 36b6772d828145f8fbba3c49746c86838683f9ba
build type FASTDEBUG
built by None at 20 Nov 2026 08:44:26 UTC on bdcb31816ec0
build id 14873
ASAN enabled
I20261120 09:03:47.510874 25986 env_posix.cc:2337] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261120 09:03:47.512691 25986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261120 09:03:47.521207 25992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261120 09:03:47.521347 25991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261120 09:03:47.521724 25994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261120 09:03:47.522749 25986 server_base.cc:1061] running on GCE node
I20261120 09:03:47.523499 25986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261120 09:03:47.524838 25986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261120 09:03:47.526096 25986 hybrid_clock.cc:648] HybridClock initialized: now 1795165427526063 us; error 49 us; skew 500 ppm
I20261120 09:03:47.526468 25986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261120 09:03:47.528646 25986 webserver.cc:577] Webserver started at http://127.23.79.126:33973/ using document root <none> and password file <none>
I20261120 09:03:47.529386 25986 fs_manager.cc:362] Metadata directory not provided
I20261120 09:03:47.529541 25986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261120 09:03:47.535038 25986 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.001s
I20261120 09:03:47.537910 26000 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261120 09:03:47.539633 25986 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20261120 09:03:47.539824 25986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data,/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/wal
uuid: "a99947e985094a3e8999fe2aa4e23f18"
format_stamp: "Formatted at 2026-11-20 09:03:19 on dist-test-slave-vzd6"
I20261120 09:03:47.540536 25986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261120 09:03:47.555732 25986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261120 09:03:47.556576 25986 env_posix.cc:2337] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261120 09:03:47.556872 25986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261120 09:03:47.577620 25986 rpc_server.cc:307] RPC server started. Bound to: 127.23.79.126:41659
I20261120 09:03:47.577631 26051 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.79.126:41659 every 8 connection(s)
I20261120 09:03:47.579478 25986 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-0/data/info.pb
I20261120 09:03:47.586236 26052 sys_catalog.cc:263] Verifying existing consensus state
I20261120 09:03:47.588549 23869 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu as pid 25986
I20261120 09:03:47.589995 26052 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: Bootstrap starting.
I20261120 09:03:47.607955 24708 heartbeater.cc:345] Connected to a master server at 127.23.79.126:41659
I20261120 09:03:47.613109 26052 log.cc:826] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: Log is configured to *not* fsync() on all Append() calls
I20261120 09:03:47.627302 24855 heartbeater.cc:345] Connected to a master server at 127.23.79.126:41659
I20261120 09:03:47.676338 26052 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: Bootstrap replayed 1/1 log segments. Stats: ops{read=86 overwritten=0 applied=86 ignored=0} inserts{seen=62 ignored=0} mutations{seen=70 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261120 09:03:47.676879 26052 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: Bootstrap complete.
I20261120 09:03:47.682361 26052 raft_consensus.cc:366] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:47.683187 26052 raft_consensus.cc:787] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99947e985094a3e8999fe2aa4e23f18, State: Initialized, Role: FOLLOWER
I20261120 09:03:47.683784 26052 consensus_queue.cc:261] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 86, Last appended: 7.86, Last appended by leader: 86, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:47.684499 26057 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:47.684782 26057 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:47.685609 26052 sys_catalog.cc:565] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: configured and running, proceeding with master startup.
I20261120 09:03:47.697837 26071 catalog_manager.cc:1310] Loaded cluster ID: b96ccaeeefb845f4962e35569b62531b
I20261120 09:03:47.698001 26071 catalog_manager.cc:1603] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: loading cluster ID for follower catalog manager: success
I20261120 09:03:47.703395 26071 catalog_manager.cc:1625] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: acquiring CA information for follower catalog manager: success
I20261120 09:03:47.707168 26071 catalog_manager.cc:1653] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20261120 09:03:47.707065 25986 master_runner.cc:187] Error getting master registration for 127.23.79.125:45319: Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111), 
I20261120 09:03:47.712404 25986 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:03:48.078576 24568 heartbeater.cc:345] Connected to a master server at 127.23.79.126:41659
I20261120 09:03:48.081262 26017 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" instance_seqno: 1795165401200304) as {username='slave'} at 127.23.79.65:51469; Asking this server to re-register.
I20261120 09:03:48.082209 24568 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:48.084848 26017 ts_manager.cc:210] Registered new tserver with Master: 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:48.112264 26017 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" instance_seqno: 1795165401905746) as {username='slave'} at 127.23.79.66:53569; Asking this server to re-register.
I20261120 09:03:48.112897 24708 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:48.114562 26017 ts_manager.cc:210] Registered new tserver with Master: 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879)
I20261120 09:03:48.130666 26017 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" instance_seqno: 1795165402395308) as {username='slave'} at 127.23.79.67:50375; Asking this server to re-register.
I20261120 09:03:48.131281 24855 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:48.132622 26017 ts_manager.cc:210] Registered new tserver with Master: 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:48.288003 26075 raft_consensus.cc:534] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:48.288273 26075 raft_consensus.cc:556] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:48.290042 26075 leader_election.cc:290] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319), d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881)
W20261120 09:03:48.291105 26001 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.124:33881: connect: Connection refused (error 111)
W20261120 09:03:48.292425 26001 leader_election.cc:336] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881): Network error: Client connection negotiation failed: client connection to 127.23.79.124:33881: connect: Connection refused (error 111)
W20261120 09:03:48.292629 26003 leader_election.cc:336] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:03:48.292786 26003 leader_election.cc:304] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99947e985094a3e8999fe2aa4e23f18; no voters: d2b1940991ac40bd916579d581e689f4, d82bf27d60fa450e8f941d1a9d36a825
I20261120 09:03:48.293116 26075 raft_consensus.cc:2966] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20261120 09:03:49.001070 26079 raft_consensus.cc:534] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:49.001230 26079 raft_consensus.cc:556] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:49.001886 26079 leader_election.cc:290] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319), d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881)
W20261120 09:03:49.003965 26003 leader_election.cc:336] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:03:49.004437 26001 leader_election.cc:336] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881): Network error: Client connection negotiation failed: client connection to 127.23.79.124:33881: connect: Connection refused (error 111)
I20261120 09:03:49.004536 26001 leader_election.cc:304] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99947e985094a3e8999fe2aa4e23f18; no voters: d2b1940991ac40bd916579d581e689f4, d82bf27d60fa450e8f941d1a9d36a825
I20261120 09:03:49.004827 26079 raft_consensus.cc:2966] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20261120 09:03:49.668382 26084 raft_consensus.cc:534] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:49.668588 26084 raft_consensus.cc:556] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:49.669247 26084 leader_election.cc:290] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319), d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881)
W20261120 09:03:49.671466 26001 leader_election.cc:336] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881): Network error: Client connection negotiation failed: client connection to 127.23.79.124:33881: connect: Connection refused (error 111)
W20261120 09:03:49.671679 26003 leader_election.cc:336] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:03:49.671835 26003 leader_election.cc:304] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99947e985094a3e8999fe2aa4e23f18; no voters: d2b1940991ac40bd916579d581e689f4, d82bf27d60fa450e8f941d1a9d36a825
I20261120 09:03:49.672175 26084 raft_consensus.cc:2966] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20261120 09:03:50.998080 23869 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu
/tmp/dist-test-taskH9EWc6/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.79.124:33881
--webserver_interface=127.23.79.124
--webserver_port=39545
--builtin_ntp_servers=127.23.79.84:36147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881
--hive_metastore_uris=thrift://127.0.0.1:38755
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20261120 09:03:51.006826 26091 raft_consensus.cc:534] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:51.007045 26091 raft_consensus.cc:556] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:51.007805 26091 leader_election.cc:290] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319), d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881)
W20261120 09:03:51.019768 26001 leader_election.cc:336] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881): Network error: Client connection negotiation failed: client connection to 127.23.79.124:33881: connect: Connection refused (error 111)
W20261120 09:03:51.019984 26003 leader_election.cc:336] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:03:51.020159 26003 leader_election.cc:304] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a99947e985094a3e8999fe2aa4e23f18; no voters: d2b1940991ac40bd916579d581e689f4, d82bf27d60fa450e8f941d1a9d36a825
I20261120 09:03:51.020473 26091 raft_consensus.cc:2966] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20261120 09:03:51.381560 26090 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261120 09:03:51.381826 26090 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261120 09:03:51.381971 26090 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261120 09:03:51.390341 26090 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20261120 09:03:51.390412 26090 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261120 09:03:51.390486 26090 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20261120 09:03:51.390600 26090 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20261120 09:03:51.400555 26090 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.79.84:36147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:38755
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.79.124:33881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.23.79.124
--webserver_port=39545
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 36b6772d828145f8fbba3c49746c86838683f9ba
build type FASTDEBUG
built by None at 20 Nov 2026 08:44:26 UTC on bdcb31816ec0
build id 14873
ASAN enabled
I20261120 09:03:51.402216 26090 env_posix.cc:2337] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261120 09:03:51.404028 26090 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261120 09:03:51.412009 26099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261120 09:03:51.413511 26100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261120 09:03:51.414606 26102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261120 09:03:51.415539 26090 server_base.cc:1061] running on GCE node
I20261120 09:03:51.416332 26090 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261120 09:03:51.417991 26090 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261120 09:03:51.419239 26090 hybrid_clock.cc:648] HybridClock initialized: now 1795165431419156 us; error 76 us; skew 500 ppm
I20261120 09:03:51.419607 26090 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20261120 09:03:51.421941 26090 webserver.cc:577] Webserver started at http://127.23.79.124:39545/ using document root <none> and password file <none>
I20261120 09:03:51.422732 26090 fs_manager.cc:362] Metadata directory not provided
I20261120 09:03:51.422855 26090 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261120 09:03:51.427948 26090 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.001s	sys 0.003s
I20261120 09:03:51.430781 26108 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261120 09:03:51.432179 26090 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20261120 09:03:51.432370 26090 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data,/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/wal
uuid: "d82bf27d60fa450e8f941d1a9d36a825"
format_stamp: "Formatted at 2026-11-20 09:03:20 on dist-test-slave-vzd6"
I20261120 09:03:51.433043 26090 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261120 09:03:51.463780 26090 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261120 09:03:51.464778 26090 env_posix.cc:2337] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261120 09:03:51.465119 26090 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261120 09:03:51.486025 26090 rpc_server.cc:307] RPC server started. Bound to: 127.23.79.124:33881
I20261120 09:03:51.486110 26159 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.79.124:33881 every 8 connection(s)
I20261120 09:03:51.488325 26090 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/master-2/data/info.pb
I20261120 09:03:51.493620 23869 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskH9EWc6/build/asan/bin/kudu as pid 26090
I20261120 09:03:51.496554 26160 sys_catalog.cc:263] Verifying existing consensus state
I20261120 09:03:51.502310 26160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: Bootstrap starting.
I20261120 09:03:51.522994 26160 log.cc:826] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: Log is configured to *not* fsync() on all Append() calls
I20261120 09:03:51.598809 26160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: Bootstrap replayed 1/1 log segments. Stats: ops{read=86 overwritten=0 applied=86 ignored=0} inserts{seen=62 ignored=0} mutations{seen=70 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261120 09:03:51.599700 26160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: Bootstrap complete.
I20261120 09:03:51.607409 26160 raft_consensus.cc:366] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 7 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:51.608119 26160 raft_consensus.cc:787] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 7 FOLLOWER]: Becoming Follower/Learner. State: Replica: d82bf27d60fa450e8f941d1a9d36a825, State: Initialized, Role: FOLLOWER
I20261120 09:03:51.608930 26160 consensus_queue.cc:261] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 86, Last appended: 7.86, Last appended by leader: 86, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:51.609905 26165 sys_catalog.cc:455] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:51.610262 26165 sys_catalog.cc:458] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:51.611089 26160 sys_catalog.cc:565] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: configured and running, proceeding with master startup.
I20261120 09:03:51.623468 26179 catalog_manager.cc:1310] Loaded cluster ID: b96ccaeeefb845f4962e35569b62531b
I20261120 09:03:51.623673 26179 catalog_manager.cc:1603] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: loading cluster ID for follower catalog manager: success
I20261120 09:03:51.628238 26179 catalog_manager.cc:1625] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: acquiring CA information for follower catalog manager: success
I20261120 09:03:51.631425 26179 catalog_manager.cc:1653] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20261120 09:03:51.650830 26090 master_runner.cc:187] Error getting master registration for 127.23.79.125:45319: Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111), 
I20261120 09:03:51.655038 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:03:51.837489 24707 heartbeater.cc:345] Connected to a master server at 127.23.79.124:33881
I20261120 09:03:51.838405 24562 heartbeater.cc:345] Connected to a master server at 127.23.79.124:33881
I20261120 09:03:51.839946 24854 heartbeater.cc:345] Connected to a master server at 127.23.79.124:33881
I20261120 09:03:51.841378 26124 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" instance_seqno: 1795165401905746) as {username='slave'} at 127.23.79.66:35797; Asking this server to re-register.
I20261120 09:03:51.841403 26125 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" instance_seqno: 1795165401200304) as {username='slave'} at 127.23.79.65:59689; Asking this server to re-register.
I20261120 09:03:51.841926 26123 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" instance_seqno: 1795165402395308) as {username='slave'} at 127.23.79.67:44161; Asking this server to re-register.
I20261120 09:03:51.842401 24707 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:51.842569 24562 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:51.842664 24854 heartbeater.cc:462] Registering TS with master...
I20261120 09:03:51.844866 26123 ts_manager.cc:210] Registered new tserver with Master: 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035)
I20261120 09:03:51.845024 26124 ts_manager.cc:210] Registered new tserver with Master: 2fb9ff0dc3d849d7bcf95806233d2c62 (127.23.79.66:38879)
I20261120 09:03:51.845108 26125 ts_manager.cc:210] Registered new tserver with Master: 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:03:51.935969 26185 raft_consensus.cc:534] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:03:51.936183 26185 raft_consensus.cc:556] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:51.936962 26185 leader_election.cc:290] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319), d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881)
W20261120 09:03:51.940301 26003 leader_election.cc:336] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:03:51.944233 26135 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a99947e985094a3e8999fe2aa4e23f18" candidate_term: 8 candidate_status { last_received { term: 7 index: 86 } } ignore_live_leader: false dest_uuid: "d82bf27d60fa450e8f941d1a9d36a825" is_pre_election: true
I20261120 09:03:51.944854 26135 raft_consensus.cc:2062] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 7 FOLLOWER]: Leader pre-election vote request: granting yes vote for candidate a99947e985094a3e8999fe2aa4e23f18 in term 7
I20261120 09:03:51.945518 26001 leader_election.cc:304] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99947e985094a3e8999fe2aa4e23f18, d82bf27d60fa450e8f941d1a9d36a825; no voters: d2b1940991ac40bd916579d581e689f4
I20261120 09:03:51.945984 26185 raft_consensus.cc:3024] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20261120 09:03:51.946138 26185 raft_consensus.cc:534] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261120 09:03:51.946288 26185 raft_consensus.cc:3296] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 7 FOLLOWER]: Advancing to term 8
I20261120 09:03:51.947331 26185 raft_consensus.cc:556] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:51.953346 26185 leader_election.cc:290] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 election: Requested vote from peers d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319), d82bf27d60fa450e8f941d1a9d36a825 (127.23.79.124:33881)
I20261120 09:03:51.954021 26135 tablet_service.cc:1901] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a99947e985094a3e8999fe2aa4e23f18" candidate_term: 8 candidate_status { last_received { term: 7 index: 86 } } ignore_live_leader: false dest_uuid: "d82bf27d60fa450e8f941d1a9d36a825"
I20261120 09:03:51.954265 26135 raft_consensus.cc:3296] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 7 FOLLOWER]: Advancing to term 8
W20261120 09:03:51.954865 26003 leader_election.cc:336] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:03:51.954921 26135 raft_consensus.cc:2062] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader election vote request: granting yes vote for candidate a99947e985094a3e8999fe2aa4e23f18 in term 8
I20261120 09:03:51.959043 26001 leader_election.cc:304] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a99947e985094a3e8999fe2aa4e23f18, d82bf27d60fa450e8f941d1a9d36a825; no voters: d2b1940991ac40bd916579d581e689f4
I20261120 09:03:51.959353 26185 raft_consensus.cc:3024] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 8 FOLLOWER]: Leader election won for term 8
I20261120 09:03:51.959522 26185 raft_consensus.cc:744] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [term 8 LEADER]: Becoming Leader. State: Replica: a99947e985094a3e8999fe2aa4e23f18, State: Running, Role: LEADER
I20261120 09:03:51.960016 26185 consensus_queue.cc:238] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 86, Committed index: 86, Last appended: 7.86, Last appended by leader: 86, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:51.962967 26189 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a99947e985094a3e8999fe2aa4e23f18. Latest consensus state: current_term: 8 leader_uuid: "a99947e985094a3e8999fe2aa4e23f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:51.963218 26189 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: This master's current role is: LEADER
I20261120 09:03:51.963946 26191 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261120 09:03:51.966539 26135 raft_consensus.cc:1338] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Refusing update from remote peer a99947e985094a3e8999fe2aa4e23f18: Log matching property violated. Preceding OpId in replica: term: 7 index: 86. Preceding OpId from leader: term: 8 index: 87. (index mismatch)
I20261120 09:03:51.967803 26191 catalog_manager.cc:694] Loaded metadata for table default.table_797fe36dbbf14c0c8e085d8470e75a24 [id=07e09703ed284b73a0c9915d40065e82]
I20261120 09:03:51.968458 26191 catalog_manager.cc:694] Loaded metadata for table default.table_5b01ae1724c5451c8ac9c936c5c8c983 [id=0bfc8c6dc2e94a92b142bee12f2b88e8]
I20261120 09:03:51.968978 26191 catalog_manager.cc:694] Loaded metadata for table default.table_4a315c29012549dcab8e1d9373f99f30 [id=1513ff7b0a7c4bcb9127e67296a844c5]
W20261120 09:03:51.969012 26003 consensus_peers.cc:597] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 -> Peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Couldn't send request to peer d2b1940991ac40bd916579d581e689f4. Status: Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20261120 09:03:51.969304 26189 consensus_queue.cc:1049] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 87, Last known committed idx: 86, Time since last communication: 0.000s
I20261120 09:03:51.969585 26191 catalog_manager.cc:694] Loaded metadata for table default.table_b2351eb1045a47feb0ca7b7422706581 [id=268c82ae3c7448059e7674f73aad3114]
I20261120 09:03:51.970031 26191 catalog_manager.cc:694] Loaded metadata for table default.table_f9f890b63b384c3b9f30da0ba8a80c03 [id=315bdedf9fe44e5d866534884f65f6d4]
I20261120 09:03:51.970952 26191 catalog_manager.cc:694] Loaded metadata for table default.table_6a2be3a544144a99b0f343bca3024912 [id=35553b36397740a29f2588fd2a840c61]
I20261120 09:03:51.971482 26191 catalog_manager.cc:694] Loaded metadata for table default.table_b329d3b2bb9a409b9290011073304555 [id=3f913310fd9a49b6b264540325c0139e]
I20261120 09:03:51.972033 26191 catalog_manager.cc:694] Loaded metadata for table default.table_414553f5c3994f4097d7fdbf9dc01082 [id=55152bf51e49475ea6391839e6630cd0]
I20261120 09:03:51.972599 26191 catalog_manager.cc:694] Loaded metadata for table default.table_f0940064a6844fdaadb8859f4257b11f [id=6a7afe82b2724dccb508eb95158c7ec7]
I20261120 09:03:51.973140 26191 catalog_manager.cc:694] Loaded metadata for table default.table_67a0134c1cdf49a49bea9d4b2818b558 [id=7510ae7af246485ca9d5b539b3f90bbb]
I20261120 09:03:51.973629 26191 catalog_manager.cc:694] Loaded metadata for table default.table_0d4b09a9b1754e38bca62e97c14a0854 [id=83bafe99e25046a4a43a3739a3ca07a1]
I20261120 09:03:51.974172 26191 catalog_manager.cc:694] Loaded metadata for table default.table_5f2e35d59fff4bc89139835f148d0414 [id=86b210ad5a5d4f66ad1c8da6ec85dc53]
I20261120 09:03:51.974679 26191 catalog_manager.cc:694] Loaded metadata for table default.table_4d5337371cd3454fa5aae228272e5fda [id=90570e46cebe47eba97e5b980f23e909]
I20261120 09:03:51.974956 26165 sys_catalog.cc:455] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a99947e985094a3e8999fe2aa4e23f18. Latest consensus state: current_term: 8 leader_uuid: "a99947e985094a3e8999fe2aa4e23f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:51.975179 26191 catalog_manager.cc:694] Loaded metadata for table default.table_d68821f474e040e18b4d91fbbd850863 [id=9d133f08f71d42b89628f2869cbaa424]
I20261120 09:03:51.975250 26165 sys_catalog.cc:458] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:51.975675 26191 catalog_manager.cc:694] Loaded metadata for table default.table_784f78c485a74606a638a81633a149e7 [id=aa6cfb171b4c482caa17d7c0862da3d0]
I20261120 09:03:51.976128 26191 catalog_manager.cc:694] Loaded metadata for table default.table_c622167e221c4db9953d7a278bd41411 [id=b21dc844213f4fc8b0f28c935f221a1b]
I20261120 09:03:51.977586 26191 catalog_manager.cc:694] Loaded metadata for table default.table_39131cc9c462405ba3639c841ebfe256 [id=cb55967ea90e43be8da1354763f7984c]
I20261120 09:03:51.978189 26191 catalog_manager.cc:694] Loaded metadata for table default.table_1a335d2b826a4f21a34ac38ad85ff200 [id=d16648dc14594d6db8143aaa02f420a5]
I20261120 09:03:51.978659 26191 catalog_manager.cc:694] Loaded metadata for table default.table_d67fc59080cc4194b566604a649aefad [id=ec464d0cd5ec4ec2bc03ebb8a14481e0]
I20261120 09:03:51.981961 26191 tablet_loader.cc:96] loaded metadata for tablet 0bac0a6b89f34c549c5118605ed0acbf (table default.table_414553f5c3994f4097d7fdbf9dc01082 [id=55152bf51e49475ea6391839e6630cd0])
I20261120 09:03:51.982537 26191 tablet_loader.cc:96] loaded metadata for tablet 18019fa55aae42be8fb9e5421dd45630 (table default.table_0d4b09a9b1754e38bca62e97c14a0854 [id=83bafe99e25046a4a43a3739a3ca07a1])
I20261120 09:03:51.983007 26191 tablet_loader.cc:96] loaded metadata for tablet 212960af80bf45deb7c508c3356d3391 (table default.table_c622167e221c4db9953d7a278bd41411 [id=b21dc844213f4fc8b0f28c935f221a1b])
I20261120 09:03:51.983465 26191 tablet_loader.cc:96] loaded metadata for tablet 26f97270103e4956b82be66244c71301 (table default.table_39131cc9c462405ba3639c841ebfe256 [id=cb55967ea90e43be8da1354763f7984c])
I20261120 09:03:51.984072 26191 tablet_loader.cc:96] loaded metadata for tablet 2ee53da425f54c4aaed62a9211d5c2f9 (table default.table_5b01ae1724c5451c8ac9c936c5c8c983 [id=0bfc8c6dc2e94a92b142bee12f2b88e8])
I20261120 09:03:51.984509 26191 tablet_loader.cc:96] loaded metadata for tablet 32a60fc620aa4027b4653877225c0604 (table default.table_5f2e35d59fff4bc89139835f148d0414 [id=86b210ad5a5d4f66ad1c8da6ec85dc53])
I20261120 09:03:51.985319 26191 tablet_loader.cc:96] loaded metadata for tablet 5276bce755e042379220edc02e7b8f09 (table default.table_6a2be3a544144a99b0f343bca3024912 [id=35553b36397740a29f2588fd2a840c61])
I20261120 09:03:51.985438 26165 sys_catalog.cc:455] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "a99947e985094a3e8999fe2aa4e23f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:51.985689 26165 sys_catalog.cc:458] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [sys.catalog]: This master's current role is: FOLLOWER
I20261120 09:03:51.985716 26191 tablet_loader.cc:96] loaded metadata for tablet 565df75f345947bea84b343c454ea1be (table default.table_1a335d2b826a4f21a34ac38ad85ff200 [id=d16648dc14594d6db8143aaa02f420a5])
I20261120 09:03:51.986048 26191 tablet_loader.cc:96] loaded metadata for tablet 6130d88766ca4ced867fb83be00a00f5 (table default.table_67a0134c1cdf49a49bea9d4b2818b558 [id=7510ae7af246485ca9d5b539b3f90bbb])
I20261120 09:03:51.986657 26191 tablet_loader.cc:96] loaded metadata for tablet 707757cc32af4fe98d4a04e6a7498c17 (table default.table_4d5337371cd3454fa5aae228272e5fda [id=90570e46cebe47eba97e5b980f23e909])
I20261120 09:03:51.987011 26191 tablet_loader.cc:96] loaded metadata for tablet 75e156478a8a470ba5f4942cd8e6a89e (table default.table_f9f890b63b384c3b9f30da0ba8a80c03 [id=315bdedf9fe44e5d866534884f65f6d4])
I20261120 09:03:51.987327 26191 tablet_loader.cc:96] loaded metadata for tablet 8155295b7e8e40ddaedeb2e9c24f1245 (table default.table_b2351eb1045a47feb0ca7b7422706581 [id=268c82ae3c7448059e7674f73aad3114])
I20261120 09:03:51.987816 26191 tablet_loader.cc:96] loaded metadata for tablet a27e6c05e40742d4ab0116c2e22cd4ba (table default.table_784f78c485a74606a638a81633a149e7 [id=aa6cfb171b4c482caa17d7c0862da3d0])
I20261120 09:03:51.988142 26191 tablet_loader.cc:96] loaded metadata for tablet a48b8166531548208bf3ae77f7380555 (table default.table_d67fc59080cc4194b566604a649aefad [id=ec464d0cd5ec4ec2bc03ebb8a14481e0])
I20261120 09:03:51.988773 26189 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 8 leader_uuid: "a99947e985094a3e8999fe2aa4e23f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } } }
I20261120 09:03:51.988961 26189 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18 [sys.catalog]: This master's current role is: LEADER
I20261120 09:03:51.989173 26191 tablet_loader.cc:96] loaded metadata for tablet ab6cc162ae404f91a484d70756e3897f (table default.table_b329d3b2bb9a409b9290011073304555 [id=3f913310fd9a49b6b264540325c0139e])
I20261120 09:03:51.990289 26191 tablet_loader.cc:96] loaded metadata for tablet bf5c1cdd4f5c4ce6b89f099b65629910 (table default.table_797fe36dbbf14c0c8e085d8470e75a24 [id=07e09703ed284b73a0c9915d40065e82])
I20261120 09:03:51.990674 26191 tablet_loader.cc:96] loaded metadata for tablet cb09ac7d6f3c42a6b5f7cf5a900f177f (table default.table_4a315c29012549dcab8e1d9373f99f30 [id=1513ff7b0a7c4bcb9127e67296a844c5])
I20261120 09:03:51.991206 26191 tablet_loader.cc:96] loaded metadata for tablet e4979050b3154c6292e42c8a3f7c89e7 (table default.table_f0940064a6844fdaadb8859f4257b11f [id=6a7afe82b2724dccb508eb95158c7ec7])
I20261120 09:03:51.991519 26191 tablet_loader.cc:96] loaded metadata for tablet e7f41973f62a48cf8b20ec4d965bfa6e (table default.table_d68821f474e040e18b4d91fbbd850863 [id=9d133f08f71d42b89628f2869cbaa424])
I20261120 09:03:51.992022 26191 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261120 09:03:51.993409 26191 catalog_manager.cc:1310] Loaded cluster ID: b96ccaeeefb845f4962e35569b62531b
I20261120 09:03:51.993500 26191 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261120 09:03:51.995396 26191 catalog_manager.cc:1555] Loading token signing keys...
I20261120 09:03:51.996948 26191 catalog_manager.cc:6248] T 00000000000000000000000000000000 P a99947e985094a3e8999fe2aa4e23f18: Loaded TSK: 0
I20261120 09:03:51.997967 26191 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261120 09:03:51.999356 26191 catalog_manager.cc:1578] Loading latest processed Hive Metastore notification log event ID...
I20261120 09:03:52.000828 26191 catalog_manager.cc:6086] Last processed Hive Metastore notification event ID: 21
I20261120 09:03:52.135694 26017 catalog_manager.cc:2551] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55754:
table { table_name: "default.Table_b329d3b2bb9a409b9290011073304555" } modify_external_catalogs: true
I20261120 09:03:52.136031 26016 catalog_manager.cc:3588] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55754:
table { table_name: "default.Table_f0940064a6844fdaadb8859f4257b11f" } new_table_name: "default.Table_8c110d08c07849d38b1899056ea665a6" modify_external_catalogs: true
I20261120 09:03:52.136734 26010 catalog_manager.cc:3588] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55754:
table { table_name: "default.Table_67a0134c1cdf49a49bea9d4b2818b558" } new_table_name: "default.Table_eceda3a9ee26453fa14f5588cd5b09e1" modify_external_catalogs: true
I20261120 09:03:52.137174 26015 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55754:
name: "default.Table_a01c7b2bf886427c8666dcf79bf881e8"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:52.136145 26017 catalog_manager.cc:2799] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55754:
table { table_name: "default.Table_b329d3b2bb9a409b9290011073304555" } modify_external_catalogs: true
I20261120 09:03:52.136780 26014 catalog_manager.cc:3588] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55754:
table { table_name: "default.Table_39131cc9c462405ba3639c841ebfe256" } new_table_name: "default.Table_a63a3233f7d94bf99010f9b0c7cb365e" modify_external_catalogs: true
I20261120 09:03:52.139506 26012 catalog_manager.cc:2551] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55754:
table { table_name: "default.Table_4d5337371cd3454fa5aae228272e5fda" } modify_external_catalogs: true
I20261120 09:03:52.139547 26009 catalog_manager.cc:2551] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55754:
table { table_name: "default.Table_b2351eb1045a47feb0ca7b7422706581" } modify_external_catalogs: true
I20261120 09:03:52.140224 26009 catalog_manager.cc:2799] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55754:
table { table_name: "default.Table_b2351eb1045a47feb0ca7b7422706581" } modify_external_catalogs: true
I20261120 09:03:52.140170 26011 catalog_manager.cc:3588] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55754:
table { table_name: "default.Table_784f78c485a74606a638a81633a149e7" } new_table_name: "default.Table_3e6cd5f501fe4b5fbf59c65130fb50ee" modify_external_catalogs: true
I20261120 09:03:52.140586 26012 catalog_manager.cc:2799] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55754:
table { table_name: "default.Table_4d5337371cd3454fa5aae228272e5fda" } modify_external_catalogs: true
I20261120 09:03:52.139103 26008 catalog_manager.cc:2301] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55754:
name: "default.Table_91e59d6c54de41a5a752a2e1fd1f6e39"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261120 09:03:52.141366 26013 catalog_manager.cc:3588] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55754:
table { table_name: "default.Table_797fe36dbbf14c0c8e085d8470e75a24" } new_table_name: "default.Table_e3eb0aafb8fb4ce983b29a55f8b42aac" modify_external_catalogs: true
F20261120 09:03:52.144948 26070 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 26, previous 26; dumping first 6 out of 15 received events: NotificationEvent(eventId=22, eventTime=1795165406, eventType=CREATE_TABLE, dbName=default, tableName=table_c622167e221c4db9953d7a278bd41411, message={"server":"","servicePrincipal":"","db":"default","table":"table_c622167e221c4db9953d7a278bd41411","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_c622167e221c4db9953d7a278bd41411\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1795165406},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/warehouse/table_c622167e221c4db9953d7a278bd41411\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_c622167e221c4db9953d7a278bd41411\",\"kudu.table_id\":\"b21dc844213f4fc8b0f28c935f221a1b\",\"transient_lastDdlTime\":\"1795165406\",\"comment\":\"\",\"kudu.master_addresses\":\"127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"b96ccaeeefb845f4962e35569b62531b\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1795165406,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1795165406, eventType=DROP_TABLE, dbName=default, tableName=table_d68821f474e040e18b4d91fbbd850863, message={"server":"","servicePrincipal":"","db":"default","table":"table_d68821f474e040e18b4d91fbbd850863","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_d68821f474e040e18b4d91fbbd850863\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1795165403},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/warehouse/table_d68821f474e040e18b4d91fbbd850863\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_d68821f474e040e18b4d91fbbd850863\",\"kudu.table_id\":\"9d133f08f71d42b89628f2869cbaa424\",\"transient_lastDdlTime\":\"1795165403\",\"comment\":\"\",\"kudu.master_addresses\":\"127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"b96ccaeeefb845f4962e35569b62531b\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1795165406}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=24, eventTime=1795165407, eventType=ALTER_TABLE, dbName=default, tableName=table_a63a3233f7d94bf99010f9b0c7cb365e, message={"server":"","servicePrincipal":"","db":"default","table":"table_39131cc9c462405ba3639c841ebfe256","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_39131cc9c462405ba3639c841ebfe256\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1795165402},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/warehouse/table_39131cc9c462405ba3639c841ebfe256\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_39131cc9c462405ba3639c841ebfe256\",\"kudu.table_id\":\"cb55967ea90e43be8da1354763f7984c\",\"transient_lastDdlTime\":\"1795165402\",\"comment\":\"\",\"kudu.master_addresses\":\"127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"b96ccaeeefb845f4962e35569b62531b\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_a63a3233f7d94bf99010f9b0c7cb365e\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1795165402},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/warehouse/table_a63a3233f7d94bf99010f9b0c7cb365e\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a63a3233f7d94bf99010f9b0c7cb365e\",\"kudu.table_id\":\"cb55967ea90e43be8da1354763f7984c\",\"transient_lastDdlTime\":\"1795165402\",\"comment\":\"\",\"kudu.master_addresses\":\"127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"b96ccaeeefb845f4962e35569b62531b\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1795165407}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=25, eventTime=1795165407, eventType=DROP_TABLE, dbName=default, tableName=table_d67fc59080cc4194b566604a649aefad, message={"server":"","servicePrincipal":"","db":"default","table":"table_d67fc59080cc4194b566604a649aefad","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_d67fc59080cc4194b566604a649aefad\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1795165403},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/warehouse/table_d67fc59080cc4194b566604a649aefad\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_d67fc59080cc4194b566604a649aefad\",\"kudu.table_id\":\"ec464d0cd5ec4ec2bc03ebb8a14481e0\",\"transient_lastDdlTime\":\"1795165403\",\"comment\":\"\",\"kudu.master_addresses\":\"127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"b96ccaeeefb845f4962e35569b62531b\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1795165407}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=26, eventTime=1795165407, eventType=CREATE_TABLE, dbName=default, tableName=table_414553f5c3994f4097d7fdbf9dc01082, message={"server":"","servicePrincipal":"","db":"default","table":"table_414553f5c3994f4097d7fdbf9dc01082","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_414553f5c3994f4097d7fdbf9dc01082\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1795165407},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/warehouse/table_414553f5c3994f4097d7fdbf9dc01082\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_414553f5c3994f4097d7fdbf9dc01082\",\"kudu.table_id\":\"55152bf51e49475ea6391839e6630cd0\",\"transient_lastDdlTime\":\"1795165407\",\"comment\":\"\",\"kudu.master_addresses\":\"127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"b96ccaeeefb845f4962e35569b62531b\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1795165407,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=26, eventTime=1795165407, eventType=CREATE_TABLE, dbName=default, tableName=table_ebc744ebb12d4dd498ca3721c3b9ac6a, message={"server":"","servicePrincipal":"","db":"default","table":"table_ebc744ebb12d4dd498ca3721c3b9ac6a","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_ebc744ebb12d4dd498ca3721c3b9ac6a\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1795165407},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskH9EWc6/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1795165384322636-23869-0/minicluster-data/warehouse/table_ebc744ebb12d4dd498ca3721c3b9ac6a\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_ebc744ebb12d4dd498ca3721c3b9ac6a\",\"kudu.table_id\":\"30da2006c3bb45c2b945f08d7cbe6945\",\"transient_lastDdlTime\":\"1795165407\",\"comment\":\"\",\"kudu.master_addresses\":\"127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"b96ccaeeefb845f4962e35569b62531b\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1795165407,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
    @     0x7f4329511d5d  google::LogMessage::Fail() at ??:0
    @     0x7f4329515b23  google::LogMessage::SendToLog() at ??:0
    @     0x7f432951175c  google::LogMessage::Flush() at ??:0
    @     0x7f43295119a1  google::LogMessage::~LogMessage() at ??:0
    @     0x7f433e9e13f4  kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
    @     0x7f433e9dfca1  kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
    @     0x7f433e9e791c  kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
    @     0x7f433e9e7799  std::_Function_handler<>::_M_invoke() at ??:0
    @           0x372c7d  std::function<>::operator()() at /home/jenkins-slave/workspace/build_and_test/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/asan/../sanitizer_common/sanitizer_common_interceptors.inc:5196
    @     0x7f432a95bdd9  kudu::Thread::SuperviseThread() at ??:0
    @     0x7f432e0446db  start_thread at ??:0
    @     0x7f4326aa561f  clone at ??:0
W20261120 09:03:52.327854 24864 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.23.79.126:41659)
W20261120 09:03:52.328578 24864 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.23.79.126:41659)
W20261120 09:03:52.328871 24864 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.23.79.126:41659)
W20261120 09:03:52.329435 24864 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.23.79.126:41659)
I20261120 09:03:52.478770 26165 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:03:52.479010 26165 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:52.480701 26165 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:03:52.481598 26111 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:03:52.484256 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:03:52.484464 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
I20261120 09:03:52.484630 26112 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:03:52.485004 26165 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:03:52.608829 24568 heartbeater.cc:500] Master 127.23.79.126:41659 was elected leader, sending a full tablet report...
I20261120 09:03:53.229952 26215 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:03:53.230141 26215 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:53.230960 26215 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:03:53.233144 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:03:53.233340 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
I20261120 09:03:53.233455 26112 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:03:53.233767 26215 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:03:54.138857 23869 master-stress-test.cc:579] Killing test thread 1/25
I20261120 09:03:54.232833 26219 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:03:54.233042 26219 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:54.233723 26219 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:03:54.236459 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:03:54.236732 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
I20261120 09:03:54.236850 26112 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:03:54.237094 26219 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:03:55.556232 26224 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:03:55.556442 26224 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:55.557096 26224 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:03:55.559280 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:03:55.559455 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:03:55.559605 26111 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:03:55.559837 26224 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:03:56.656387 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:03:56.656562 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:03:56.977813 26230 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:03:56.978031 26230 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:56.978760 26230 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:03:56.980360 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:03:56.980708 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:03:56.980811 26111 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:03:56.981035 26230 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:03:58.749647 26233 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:03:58.749873 26233 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:03:58.750620 26233 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:03:58.751623 26111 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20261120 09:03:58.752786 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:03:58.752945 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:03:58.753118 26111 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:03:58.753419 26233 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:04:01.657809 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:04:01.657989 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:04:01.772197 26243 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:04:01.772414 26243 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:04:01.773094 26243 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:04:01.774849 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:04:01.775017 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:04:01.775173 26111 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:04:01.775486 26243 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:04:02.659981 26247 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:04:02.660197 26247 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:04:02.661031 26247 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:04:02.663373 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:04:02.663604 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
I20261120 09:04:02.663714 26112 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:04:02.663957 26247 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:04:03.632848 26251 raft_consensus.cc:534] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:04:03.633029 26251 raft_consensus.cc:556] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:04:03.633895 26251 leader_election.cc:290] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
W20261120 09:04:03.634968 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
W20261120 09:04:03.635226 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:04:03.635337 24595 leader_election.cc:304] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:04:03.635639 26251 raft_consensus.cc:2966] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:04:06.659452 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:04:06.659705 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:04:08.625146 26256 raft_consensus.cc:534] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:04:08.625350 26256 raft_consensus.cc:556] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:04:08.625909 26257 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:04:08.626083 26256 leader_election.cc:290] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
I20261120 09:04:08.626098 26257 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:04:08.626989 26257 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:04:08.627377 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
W20261120 09:04:08.628043 26112 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20261120 09:04:08.628845 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:04:08.629061 24595 leader_election.cc:304] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:04:08.629379 26256 raft_consensus.cc:2966] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20261120 09:04:08.630927 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:04:08.631148 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:04:08.631291 26111 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:04:08.631524 26257 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:04:11.661063 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:04:11.661290 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:04:11.944360 26262 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:04:11.944569 26262 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:04:11.945304 26262 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:04:11.947240 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:04:11.947597 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:04:11.947702 26111 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:04:11.948014 26262 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:04:16.662967 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:04:16.663219 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:04:17.177484 26271 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:04:17.177668 26271 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:04:17.178332 26271 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:04:17.179526 26112 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20261120 09:04:17.180790 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:04:17.180960 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
I20261120 09:04:17.181077 26112 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:04:17.181422 26271 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:04:18.765468 26276 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:04:18.765677 26276 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:04:18.766499 26276 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:04:18.768690 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:04:18.768889 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:04:18.769032 26111 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:04:18.769307 26276 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:04:19.635252 26266 raft_consensus.cc:534] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:04:19.635437 26266 raft_consensus.cc:556] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:04:19.636376 26266 leader_election.cc:290] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
W20261120 09:04:19.637224 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
W20261120 09:04:19.637491 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:04:19.637570 24595 leader_election.cc:304] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:04:19.637899 26266 raft_consensus.cc:2966] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:04:21.667378 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:04:21.667631 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20261120 09:04:23.120226 24574 heartbeater.cc:648] Failed to heartbeat to 127.23.79.125:45319 (106 consecutive failures): Network error: Failed to ping master at 127.23.79.125:45319: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:04:23.147321 24709 heartbeater.cc:648] Failed to heartbeat to 127.23.79.125:45319 (106 consecutive failures): Network error: Failed to ping master at 127.23.79.125:45319: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:04:23.162904 24856 heartbeater.cc:648] Failed to heartbeat to 127.23.79.125:45319 (107 consecutive failures): Network error: Failed to ping master at 127.23.79.125:45319: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:04:26.672677 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:04:26.672863 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:04:28.857036 26288 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:04:28.857257 26288 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:04:28.858007 26288 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:04:28.859190 26112 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20261120 09:04:28.860707 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:04:28.860922 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:04:28.861038 26111 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:04:28.861249 26288 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:04:29.908422 26284 raft_consensus.cc:534] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:04:29.908618 26284 raft_consensus.cc:556] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:04:29.909334 26284 leader_election.cc:290] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
W20261120 09:04:29.910101 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
W20261120 09:04:29.910375 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:04:29.910466 24595 leader_election.cc:304] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:04:29.910753 26284 raft_consensus.cc:2966] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:04:31.674135 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:04:31.674345 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:04:36.675752 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:04:36.675999 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:04:41.677417 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:04:41.677634 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:04:42.577698 26301 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:04:42.577891 26301 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:04:42.578763 26301 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:04:42.579751 26112 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20261120 09:04:42.580978 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:04:42.581111 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:04:42.581300 26111 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:04:42.581586 26301 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:04:46.679131 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:04:46.679374 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:04:47.382187 26307 raft_consensus.cc:534] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:04:47.382453 26307 raft_consensus.cc:556] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:04:47.383284 26307 leader_election.cc:290] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
W20261120 09:04:47.384088 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
W20261120 09:04:47.384341 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:04:47.384445 24595 leader_election.cc:304] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:04:47.384728 26307 raft_consensus.cc:2966] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:04:51.680974 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:04:51.681208 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:04:54.104038 26315 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:04:54.104238 26315 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:04:54.104984 26315 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:04:54.105893 26112 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20261120 09:04:54.107488 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:04:54.107635 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:04:54.107792 26111 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:04:54.108072 26315 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:04:56.682325 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:04:56.682480 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:05:01.684068 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:05:01.684279 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:05:06.685798 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:05:06.686018 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:05:06.805766 26324 raft_consensus.cc:534] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:05:06.805953 26324 raft_consensus.cc:556] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:05:06.806668 26324 leader_election.cc:290] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
W20261120 09:05:06.807518 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
W20261120 09:05:06.807791 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:05:06.807928 24595 leader_election.cc:304] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:05:06.808188 26324 raft_consensus.cc:2966] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:05:06.959069 26329 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:05:06.959708 26329 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:05:06.960475 26329 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:05:06.961135 26111 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20261120 09:05:06.962630 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:05:06.962828 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
I20261120 09:05:06.962987 26112 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:05:06.963286 26329 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:05:11.687472 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:05:11.687739 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:05:14.357486 26338 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:05:14.357697 26338 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:05:14.358493 26338 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:05:14.359511 26112 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20261120 09:05:14.360915 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:05:14.361498 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:05:14.361605 26111 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:05:14.361878 26338 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:05:16.689261 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:05:16.689483 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:05:21.691037 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:05:21.691260 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20261120 09:05:23.258826 24574 heartbeater.cc:648] Failed to heartbeat to 127.23.79.125:45319 (226 consecutive failures): Network error: Failed to ping master at 127.23.79.125:45319: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:05:23.283818 24709 heartbeater.cc:648] Failed to heartbeat to 127.23.79.125:45319 (226 consecutive failures): Network error: Failed to ping master at 127.23.79.125:45319: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:05:23.291844 24856 heartbeater.cc:648] Failed to heartbeat to 127.23.79.125:45319 (227 consecutive failures): Network error: Failed to ping master at 127.23.79.125:45319: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:05:25.362104 26336 raft_consensus.cc:534] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:05:25.362309 26336 raft_consensus.cc:556] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:05:25.363196 26336 leader_election.cc:290] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
W20261120 09:05:25.363957 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
W20261120 09:05:25.364171 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:05:25.364238 24595 leader_election.cc:304] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:05:25.364444 26336 raft_consensus.cc:2966] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:05:26.692585 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:05:26.692772 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:05:28.126572 26352 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:05:28.126780 26352 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:05:28.127419 26352 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:05:28.128400 26112 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20261120 09:05:28.130048 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:05:28.130295 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
I20261120 09:05:28.130384 26112 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:05:28.130633 26352 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:05:31.057786 26358 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:05:31.057969 26358 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:05:31.058946 26358 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:05:31.061002 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:05:31.061337 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:05:31.061436 26111 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:05:31.061733 26358 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:05:31.694267 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:05:31.694495 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:05:36.695809 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:05:36.696027 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:05:37.022308 26357 raft_consensus.cc:534] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:05:37.022552 26357 raft_consensus.cc:556] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:05:37.023234 26357 leader_election.cc:290] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
W20261120 09:05:37.024156 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
W20261120 09:05:37.024309 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:05:37.024410 24595 leader_election.cc:304] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:05:37.024624 26357 raft_consensus.cc:2966] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:05:41.257932 26357 raft_consensus.cc:534] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:05:41.258086 26357 raft_consensus.cc:556] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:05:41.259069 26357 leader_election.cc:290] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
W20261120 09:05:41.260004 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
W20261120 09:05:41.260246 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:05:41.260325 24595 leader_election.cc:304] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:05:41.260525 26357 raft_consensus.cc:2966] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:05:41.697885 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:05:41.698150 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:05:44.036463 26372 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:05:44.036639 26372 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:05:44.037353 26372 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:05:44.038923 26112 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20261120 09:05:44.040295 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:05:44.040462 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:05:44.040565 26111 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:05:44.040762 26372 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:05:46.699811 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:05:46.700048 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:05:49.169452 26380 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:05:49.169652 26380 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:05:49.170457 26380 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:05:49.171448 26111 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20261120 09:05:49.173144 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:05:49.173377 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
I20261120 09:05:49.173511 26112 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:05:49.173770 26380 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:05:51.630241 26114 maintenance_manager.cc:419] P d82bf27d60fa450e8f941d1a9d36a825: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033339
I20261120 09:05:51.680831 26113 maintenance_manager.cc:643] P d82bf27d60fa450e8f941d1a9d36a825: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.049s	user 0.022s	sys 0.004s Metrics: {"bytes_written":21374,"cfile_init":1,"dirs.queue_time_us":362,"dirs.run_cpu_time_us":193,"dirs.run_wall_time_us":963,"drs_written":1,"lbm_read_time_us":63,"lbm_reads_lt_1ms":4,"lbm_write_time_us":572,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":55,"thread_start_us":426,"threads_started":2,"wal-append.queue_time_us":268}
I20261120 09:05:51.682044 26114 maintenance_manager.cc:419] P d82bf27d60fa450e8f941d1a9d36a825: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 3552 bytes on disk
I20261120 09:05:51.682897 26113 maintenance_manager.cc:643] P d82bf27d60fa450e8f941d1a9d36a825: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":78,"lbm_reads_lt_1ms":4}
I20261120 09:05:51.701341 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:05:51.701524 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:05:52.411659 26379 raft_consensus.cc:534] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:05:52.411944 26379 raft_consensus.cc:556] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:05:52.412712 26379 leader_election.cc:290] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
W20261120 09:05:52.413725 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
W20261120 09:05:52.413968 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:05:52.414096 24595 leader_election.cc:304] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:05:52.414366 26379 raft_consensus.cc:2966] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:05:55.610914 26388 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:05:55.611208 26388 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:05:55.612411 26388 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:05:55.613471 26112 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20261120 09:05:55.614923 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:05:55.615135 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
I20261120 09:05:55.615253 26112 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:05:55.615543 26388 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:05:56.702831 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:05:56.703018 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:06:01.704879 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:06:01.705073 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:06:03.464458 26379 raft_consensus.cc:534] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:06:03.464628 26379 raft_consensus.cc:556] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:06:03.465945 26379 leader_election.cc:290] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
W20261120 09:06:03.466799 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
W20261120 09:06:03.467026 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:06:03.467101 24595 leader_election.cc:304] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:06:03.467371 26379 raft_consensus.cc:2966] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:06:06.706413 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:06:06.706669 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:06:06.725044 26434 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:06:06.725244 26434 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:06:06.726128 26434 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:06:06.726692 26112 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20261120 09:06:06.728029 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:06:06.728197 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:06:06.728338 26111 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:06:06.728605 26434 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:06:11.708109 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:06:11.708361 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:06:12.195580 26439 raft_consensus.cc:534] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:06:12.195779 26439 raft_consensus.cc:556] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:06:12.196461 26439 leader_election.cc:290] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
W20261120 09:06:12.197752 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
W20261120 09:06:12.197995 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:06:12.198155 24595 leader_election.cc:304] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:06:12.198487 26439 raft_consensus.cc:2966] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:06:13.337147 26468 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:06:13.337353 26468 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:06:13.338215 26468 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:06:13.339200 26112 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20261120 09:06:13.340616 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:06:13.340761 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:06:13.340938 26111 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:06:13.341202 26468 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:06:16.710493 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:06:16.710753 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:06:17.930037 26439 raft_consensus.cc:534] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:06:17.930295 26439 raft_consensus.cc:556] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:06:17.930972 26439 leader_election.cc:290] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
W20261120 09:06:17.931967 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
W20261120 09:06:17.932159 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:06:17.932230 24595 leader_election.cc:304] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:06:17.932459 26439 raft_consensus.cc:2966] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:06:21.493516 26508 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:06:21.493754 26508 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:06:21.494426 26508 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:06:21.495443 26112 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20261120 09:06:21.496656 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:06:21.496891 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:06:21.497018 26111 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:06:21.497233 26508 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:06:21.711790 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:06:21.712040 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20261120 09:06:23.397629 24574 heartbeater.cc:648] Failed to heartbeat to 127.23.79.125:45319 (346 consecutive failures): Network error: Failed to ping master at 127.23.79.125:45319: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:06:23.420704 24856 heartbeater.cc:648] Failed to heartbeat to 127.23.79.125:45319 (347 consecutive failures): Network error: Failed to ping master at 127.23.79.125:45319: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:06:23.420719 24709 heartbeater.cc:648] Failed to heartbeat to 127.23.79.125:45319 (346 consecutive failures): Network error: Failed to ping master at 127.23.79.125:45319: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:06:26.713567 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:06:26.713799 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:06:28.100832 26521 raft_consensus.cc:534] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:06:28.101095 26521 raft_consensus.cc:556] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:06:28.102119 26521 leader_election.cc:290] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
W20261120 09:06:28.103060 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
W20261120 09:06:28.103288 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:06:28.103399 24595 leader_election.cc:304] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:06:28.103626 26521 raft_consensus.cc:2966] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:06:31.715113 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:06:31.715317 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:06:36.716773 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:06:36.716938 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:06:37.295212 26580 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:06:37.295421 26580 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:06:37.296257 26580 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:06:37.297209 26112 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20261120 09:06:37.298475 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:06:37.298697 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
I20261120 09:06:37.298815 26112 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:06:37.299017 26580 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:06:41.718281 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:06:41.718461 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:06:44.769567 26590 raft_consensus.cc:534] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:06:44.769788 26590 raft_consensus.cc:556] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:06:44.770702 26590 leader_election.cc:290] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
W20261120 09:06:44.771628 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
W20261120 09:06:44.771859 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:06:44.771981 24595 leader_election.cc:304] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:06:44.772230 26590 raft_consensus.cc:2966] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:06:46.719802 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:06:46.719987 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:06:47.662665 26625 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:06:47.662874 26625 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:06:47.663537 26625 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:06:47.664599 26112 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20261120 09:06:47.665992 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:06:47.666232 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:06:47.666320 26111 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:06:47.666549 26625 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:06:51.721362 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:06:51.721560 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:06:56.723132 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:06:56.723321 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:07:01.724617 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:07:01.724798 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:07:02.040208 26687 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:07:02.040441 26687 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:07:02.041278 26687 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:07:02.041926 26112 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20261120 09:07:02.043406 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:07:02.043663 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:07:02.043816 26111 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:07:02.044091 26687 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:07:02.512509 26674 raft_consensus.cc:534] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:07:02.512750 26674 raft_consensus.cc:556] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:07:02.513543 26674 leader_election.cc:290] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
W20261120 09:07:02.514577 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
W20261120 09:07:02.514869 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:07:02.515002 24595 leader_election.cc:304] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:07:02.515311 26674 raft_consensus.cc:2966] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:07:06.726169 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:07:06.726377 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:07:11.727998 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:07:11.728209 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:07:16.729699 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:07:16.729924 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:07:18.590472 26712 raft_consensus.cc:534] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:07:18.590730 26712 raft_consensus.cc:556] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:07:18.591501 26712 leader_election.cc:290] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
W20261120 09:07:18.592460 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
W20261120 09:07:18.592710 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:07:18.592808 24595 leader_election.cc:304] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:07:18.593083 26712 raft_consensus.cc:2966] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:07:18.817504 26755 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:07:18.817700 26755 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:07:18.818601 26755 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:07:18.819640 26112 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20261120 09:07:18.821079 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:07:18.821280 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:07:18.821437 26111 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:07:18.821700 26755 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:07:21.731663 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:07:21.731920 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20261120 09:07:23.534840 24574 heartbeater.cc:648] Failed to heartbeat to 127.23.79.125:45319 (466 consecutive failures): Network error: Failed to ping master at 127.23.79.125:45319: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:07:23.566627 24709 heartbeater.cc:648] Failed to heartbeat to 127.23.79.125:45319 (466 consecutive failures): Network error: Failed to ping master at 127.23.79.125:45319: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:07:23.566900 24856 heartbeater.cc:648] Failed to heartbeat to 127.23.79.125:45319 (467 consecutive failures): Network error: Failed to ping master at 127.23.79.125:45319: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:07:25.677471 26712 raft_consensus.cc:534] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:07:25.677625 26712 raft_consensus.cc:556] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:07:25.678086 26712 leader_election.cc:290] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
W20261120 09:07:25.679041 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
W20261120 09:07:25.679241 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:07:25.679325 24595 leader_election.cc:304] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:07:25.679589 26712 raft_consensus.cc:2966] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:07:26.733563 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:07:26.733808 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:07:29.890400 26800 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:07:29.890602 26800 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:07:29.891213 26800 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:07:29.892264 26112 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20261120 09:07:29.893577 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:07:29.893730 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
I20261120 09:07:29.893880 26112 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:07:29.894145 26800 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:07:31.735388 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:07:31.735589 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:07:33.449925 26799 raft_consensus.cc:534] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:07:33.450124 26799 raft_consensus.cc:556] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:07:33.450846 26799 leader_election.cc:290] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
W20261120 09:07:33.451629 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
W20261120 09:07:33.451797 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:07:33.451871 24595 leader_election.cc:304] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:07:33.452054 26799 raft_consensus.cc:2966] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:07:34.174170 26820 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:07:34.174376 26820 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:07:34.175195 26820 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:07:34.177371 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:07:34.177516 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:07:34.177659 26111 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:07:34.177915 26820 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:07:36.736897 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:07:36.737095 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:07:37.989638 26836 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:07:37.989814 26836 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:07:37.990497 26836 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:07:37.991360 26112 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20261120 09:07:37.992551 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:07:37.992719 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
I20261120 09:07:37.992820 26112 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:07:37.993058 26836 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:07:41.738662 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:07:41.738876 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:07:46.740226 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:07:46.740417 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:07:48.078756 26865 raft_consensus.cc:534] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:07:48.078960 26865 raft_consensus.cc:556] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:07:48.079785 26865 leader_election.cc:290] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
W20261120 09:07:48.080749 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
W20261120 09:07:48.080955 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:07:48.081071 24595 leader_election.cc:304] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:07:48.081310 26865 raft_consensus.cc:2966] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:07:48.307626 26879 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:07:48.307798 26879 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:07:48.308462 26879 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:07:48.309511 26112 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20261120 09:07:48.310817 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:07:48.311015 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:07:48.311158 26111 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:07:48.311460 26879 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:07:51.741804 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:07:51.742002 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:07:56.743186 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:07:56.743386 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:08:01.744910 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:08:01.745117 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:08:04.093161 26865 raft_consensus.cc:534] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:08:04.093364 26865 raft_consensus.cc:556] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:08:04.094266 26865 leader_election.cc:290] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
W20261120 09:08:04.095165 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
W20261120 09:08:04.095397 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:08:04.095480 24595 leader_election.cc:304] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:08:04.095707 26865 raft_consensus.cc:2966] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:08:05.586165 26944 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:08:05.586385 26944 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:08:05.587302 26944 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:08:05.588263 26112 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20261120 09:08:05.589339 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:08:05.589484 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
I20261120 09:08:05.589625 26112 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:08:05.589856 26944 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:08:06.746577 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:08:06.746805 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:08:09.030972 26959 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:08:09.031205 26959 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:08:09.031885 26959 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:08:09.034027 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:08:09.034265 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:08:09.034404 26111 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:08:09.034664 26959 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:08:11.748560 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:08:11.748791 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:08:16.750280 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:08:16.750573 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20261120 09:08:16.996076 26939 raft_consensus.cc:534] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:08:16.996239 26939 raft_consensus.cc:556] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:08:16.996879 26939 leader_election.cc:290] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
W20261120 09:08:16.997730 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
W20261120 09:08:16.997938 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:08:16.998021 24595 leader_election.cc:304] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:08:16.998252 26939 raft_consensus.cc:2966] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:08:21.578683 27004 raft_consensus.cc:534] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a99947e985094a3e8999fe2aa4e23f18)
I20261120 09:08:21.578887 27004 raft_consensus.cc:556] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99947e985094a3e8999fe2aa4e23f18" member_type: VOTER last_known_addr { host: "127.23.79.126" port: 41659 } } peers { permanent_uuid: "d2b1940991ac40bd916579d581e689f4" member_type: VOTER last_known_addr { host: "127.23.79.125" port: 45319 } } peers { permanent_uuid: "d82bf27d60fa450e8f941d1a9d36a825" member_type: VOTER last_known_addr { host: "127.23.79.124" port: 33881 } }
I20261120 09:08:21.579567 27004 leader_election.cc:290] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659), d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319)
W20261120 09:08:21.583281 26111 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20261120 09:08:21.584491 26112 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a99947e985094a3e8999fe2aa4e23f18 (127.23.79.126:41659): Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:08:21.584671 26111 leader_election.cc:336] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2b1940991ac40bd916579d581e689f4 (127.23.79.125:45319): Network error: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:08:21.584807 26111 leader_election.cc:304] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d82bf27d60fa450e8f941d1a9d36a825; no voters: a99947e985094a3e8999fe2aa4e23f18, d2b1940991ac40bd916579d581e689f4
I20261120 09:08:21.585072 27004 raft_consensus.cc:2966] T 00000000000000000000000000000000 P d82bf27d60fa450e8f941d1a9d36a825 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20261120 09:08:21.751742 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:08:21.751957 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20261120 09:08:23.669260 24574 heartbeater.cc:648] Failed to heartbeat to 127.23.79.125:45319 (586 consecutive failures): Network error: Failed to ping master at 127.23.79.125:45319: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:08:23.700278 24856 heartbeater.cc:648] Failed to heartbeat to 127.23.79.125:45319 (587 consecutive failures): Network error: Failed to ping master at 127.23.79.125:45319: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
W20261120 09:08:23.700350 24709 heartbeater.cc:648] Failed to heartbeat to 127.23.79.125:45319 (586 consecutive failures): Network error: Failed to ping master at 127.23.79.125:45319: Client connection negotiation failed: client connection to 127.23.79.125:45319: connect: Connection refused (error 111)
I20261120 09:08:25.289418 26939 raft_consensus.cc:534] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261120 09:08:25.289642 26939 raft_consensus.cc:556] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8668dad23e404dafb0ac25267f07bd46" member_type: VOTER last_known_addr { host: "127.23.79.67" port: 41035 } } peers { permanent_uuid: "2fb9ff0dc3d849d7bcf95806233d2c62" member_type: VOTER last_known_addr { host: "127.23.79.66" port: 38879 } } peers { permanent_uuid: "2c3fe57b9d2c424da181281af303f3c3" member_type: VOTER last_known_addr { host: "127.23.79.65" port: 40677 } }
I20261120 09:08:25.290398 26939 leader_election.cc:290] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035), 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677)
W20261120 09:08:25.291481 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8668dad23e404dafb0ac25267f07bd46 (127.23.79.67:41035): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
W20261120 09:08:25.291695 24595 leader_election.cc:343] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c3fe57b9d2c424da181281af303f3c3 (127.23.79.65:40677): Not found: Tablet not found: e0311b21048c4965ad8ca3cb54bb728d
I20261120 09:08:25.291786 24595 leader_election.cc:304] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fb9ff0dc3d849d7bcf95806233d2c62; no voters: 2c3fe57b9d2c424da181281af303f3c3, 8668dad23e404dafb0ac25267f07bd46
I20261120 09:08:25.292083 26939 raft_consensus.cc:2966] T e0311b21048c4965ad8ca3cb54bb728d P 2fb9ff0dc3d849d7bcf95806233d2c62 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20261120 09:08:26.753757 26090 master_runner.cc:187] Error getting master registration for 127.23.79.126:41659: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111), 
I20261120 09:08:26.753997 26090 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20261120 09:08:27.624276 24861 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:08:27.624565 24861 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:08:27.624639 24861 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
W20261120 09:08:27.624719 24861 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
F20261120 09:08:27.635418 24892 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
*** Check failure stack trace: ***
*** Aborted at 1795165707 (unix time) try "date -d @1795165707" if you are using GNU date ***
F20261120 09:08:27.635496 24885 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635813 24890 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635850 24872 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3e4fc42431704219b0f8051a3136c83a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635896 24895 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20261120 09:08:27.635496 24885 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635813 24890 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635850 24872 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3e4fc42431704219b0f8051a3136c83a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635896 24895 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20261120 09:08:27.635496 24885 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635813 24890 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635850 24872 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3e4fc42431704219b0f8051a3136c83a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635896 24895 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20261120 09:08:27.635496 24885 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635813 24890 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635850 24872 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3e4fc42431704219b0f8051a3136c83a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635896 24895 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20261120 09:08:27.635496 24885 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635813 24890 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635850 24872 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3e4fc42431704219b0f8051a3136c83a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635896 24895 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.636992 24880 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20261120 09:08:27.635496 24885 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635813 24890 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635850 24872 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3e4fc42431704219b0f8051a3136c83a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635896 24895 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.636992 24880 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638324 24869 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2db1fa040e8a4eae9a2eaa62637fb6eb on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20261120 09:08:27.635496 24885 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635813 24890 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635850 24872 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3e4fc42431704219b0f8051a3136c83a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635896 24895 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.636992 24880 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638324 24869 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2db1fa040e8a4eae9a2eaa62637fb6eb on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638418 24876 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f2fb9ef502034f008e49c58af534c051 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20261120 09:08:27.635496 24885 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635813 24890 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635850 24872 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3e4fc42431704219b0f8051a3136c83a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635896 24895 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.636992 24880 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638324 24869 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2db1fa040e8a4eae9a2eaa62637fb6eb on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638418 24876 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f2fb9ef502034f008e49c58af534c051 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638530 24883 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20261120 09:08:27.635496 24885 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635813 24890 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635850 24872 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3e4fc42431704219b0f8051a3136c83a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635896 24895 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.636992 24880 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638324 24869 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2db1fa040e8a4eae9a2eaa62637fb6eb on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638418 24876 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f2fb9ef502034f008e49c58af534c051 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638530 24883 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638593 24874 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a01c7b2bf886427c8666dcf79bf881e8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20261120 09:08:27.635496 24885 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635813 24890 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635850 24872 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3e4fc42431704219b0f8051a3136c83a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635896 24895 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.636992 24880 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638324 24869 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2db1fa040e8a4eae9a2eaa62637fb6eb on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638418 24876 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f2fb9ef502034f008e49c58af534c051 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638530 24883 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638593 24874 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a01c7b2bf886427c8666dcf79bf881e8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638705 24875 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5a5b000e118f464abb0a40c93d617f59 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20261120 09:08:27.635496 24885 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635813 24890 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635850 24872 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3e4fc42431704219b0f8051a3136c83a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635896 24895 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.636992 24880 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638324 24869 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2db1fa040e8a4eae9a2eaa62637fb6eb on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638418 24876 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f2fb9ef502034f008e49c58af534c051 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638530 24883 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638593 24874 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a01c7b2bf886427c8666dcf79bf881e8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638705 24875 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5a5b000e118f464abb0a40c93d617f59 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.640789 24871 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3fd14a71eb6b4a6c88dbaf4a470f6361 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20261120 09:08:27.635496 24885 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635813 24890 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635850 24872 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3e4fc42431704219b0f8051a3136c83a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635896 24895 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.636992 24880 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638324 24869 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2db1fa040e8a4eae9a2eaa62637fb6eb on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638418 24876 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f2fb9ef502034f008e49c58af534c051 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638530 24883 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638593 24874 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a01c7b2bf886427c8666dcf79bf881e8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638705 24875 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5a5b000e118f464abb0a40c93d617f59 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.640789 24871 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3fd14a71eb6b4a6c88dbaf4a470f6361 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641155 24884 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20261120 09:08:27.635496 24885 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635813 24890 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635850 24872 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3e4fc42431704219b0f8051a3136c83a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635896 24895 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.636992 24880 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638324 24869 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2db1fa040e8a4eae9a2eaa62637fb6eb on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638418 24876 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f2fb9ef502034f008e49c58af534c051 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638530 24883 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638593 24874 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a01c7b2bf886427c8666dcf79bf881e8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638705 24875 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5a5b000e118f464abb0a40c93d617f59 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.640789 24871 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3fd14a71eb6b4a6c88dbaf4a470f6361 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641155 24884 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641162 24881 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20261120 09:08:27.635496 24885 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635813 24890 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635850 24872 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3e4fc42431704219b0f8051a3136c83a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635896 24895 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.636992 24880 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638324 24869 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2db1fa040e8a4eae9a2eaa62637fb6eb on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638418 24876 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f2fb9ef502034f008e49c58af534c051 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638530 24883 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638593 24874 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a01c7b2bf886427c8666dcf79bf881e8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638705 24875 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5a5b000e118f464abb0a40c93d617f59 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.640789 24871 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3fd14a71eb6b4a6c88dbaf4a470f6361 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641155 24884 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641162 24881 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641517 24882 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20261120 09:08:27.635496 24885 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635813 24890 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635850 24872 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3e4fc42431704219b0f8051a3136c83a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635896 24895 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.636992 24880 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638324 24869 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2db1fa040e8a4eae9a2eaa62637fb6eb on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638418 24876 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f2fb9ef502034f008e49c58af534c051 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638530 24883 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638593 24874 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a01c7b2bf886427c8666dcf79bf881e8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638705 24875 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5a5b000e118f464abb0a40c93d617f59 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.640789 24871 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3fd14a71eb6b4a6c88dbaf4a470f6361 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641155 24884 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641162 24881 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641517 24882 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641564 24886 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20261120 09:08:27.635496 24885 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635813 24890 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635850 24872 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3e4fc42431704219b0f8051a3136c83a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635896 24895 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.636992 24880 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638324 24869 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2db1fa040e8a4eae9a2eaa62637fb6eb on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638418 24876 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f2fb9ef502034f008e49c58af534c051 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638530 24883 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638593 24874 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a01c7b2bf886427c8666dcf79bf881e8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638705 24875 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5a5b000e118f464abb0a40c93d617f59 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.640789 24871 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3fd14a71eb6b4a6c88dbaf4a470f6361 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641155 24884 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641162 24881 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641517 24882 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641564 24886 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641530 24878 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_91e59d6c54de41a5a752a2e1fd1f6e39 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20261120 09:08:27.635496 24885 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635813 24890 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635850 24872 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3e4fc42431704219b0f8051a3136c83a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635896 24895 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.636992 24880 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638324 24869 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2db1fa040e8a4eae9a2eaa62637fb6eb on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638418 24876 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f2fb9ef502034f008e49c58af534c051 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638530 24883 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638593 24874 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a01c7b2bf886427c8666dcf79bf881e8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638705 24875 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5a5b000e118f464abb0a40c93d617f59 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.640789 24871 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3fd14a71eb6b4a6c88dbaf4a470f6361 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641155 24884 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641162 24881 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641517 24882 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641564 24886 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641530 24878 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_91e59d6c54de41a5a752a2e1fd1f6e39 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641877 24889 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
*** Check failure stack trace: ***
PC: @                0x0 (unknown)
F20261120 09:08:27.635496 24885 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635813 24890 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635850 24872 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3e4fc42431704219b0f8051a3136c83a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635896 24895 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.636992 24880 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638324 24869 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2db1fa040e8a4eae9a2eaa62637fb6eb on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638418 24876 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f2fb9ef502034f008e49c58af534c051 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638530 24883 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638593 24874 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a01c7b2bf886427c8666dcf79bf881e8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638705 24875 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5a5b000e118f464abb0a40c93d617f59 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.640789 24871 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3fd14a71eb6b4a6c88dbaf4a470f6361 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641155 24884 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641162 24881 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641517 24882 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641564 24886 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641530 24878 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_91e59d6c54de41a5a752a2e1fd1f6e39 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641877 24889 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.642391 24888 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
*** Check failure stack trace: ***
*** SIGABRT (@0x3e800005d3d) received by PID 23869 (TID 0x7fd84394b700) from PID 23869; stack trace: ***
F20261120 09:08:27.635496 24885 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635813 24890 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635850 24872 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3e4fc42431704219b0f8051a3136c83a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635896 24895 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.636992 24880 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638324 24869 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2db1fa040e8a4eae9a2eaa62637fb6eb on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638418 24876 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f2fb9ef502034f008e49c58af534c051 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638530 24883 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638593 24874 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a01c7b2bf886427c8666dcf79bf881e8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638705 24875 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5a5b000e118f464abb0a40c93d617f59 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.640789 24871 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3fd14a71eb6b4a6c88dbaf4a470f6361 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641155 24884 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641162 24881 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641517 24882 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641564 24886 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641530 24878 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_91e59d6c54de41a5a752a2e1fd1f6e39 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641877 24889 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.642391 24888 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.642829 24879 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20261120 09:08:27.635496 24885 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635813 24890 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635850 24872 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3e4fc42431704219b0f8051a3136c83a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635896 24895 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.636992 24880 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638324 24869 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2db1fa040e8a4eae9a2eaa62637fb6eb on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638418 24876 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f2fb9ef502034f008e49c58af534c051 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638530 24883 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638593 24874 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a01c7b2bf886427c8666dcf79bf881e8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638705 24875 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5a5b000e118f464abb0a40c93d617f59 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.640789 24871 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3fd14a71eb6b4a6c88dbaf4a470f6361 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641155 24884 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641162 24881 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641517 24882 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641564 24886 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641530 24878 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_91e59d6c54de41a5a752a2e1fd1f6e39 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641877 24889 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.642391 24888 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.642829 24879 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.643170 24891 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20261120 09:08:27.635496 24885 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635813 24890 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635850 24872 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3e4fc42431704219b0f8051a3136c83a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635896 24895 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.636992 24880 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638324 24869 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2db1fa040e8a4eae9a2eaa62637fb6eb on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638418 24876 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f2fb9ef502034f008e49c58af534c051 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638530 24883 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638593 24874 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a01c7b2bf886427c8666dcf79bf881e8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638705 24875 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5a5b000e118f464abb0a40c93d617f59 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.640789 24871 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3fd14a71eb6b4a6c88dbaf4a470f6361 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641155 24884 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641162 24881 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641517 24882 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641564 24886 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641530 24878 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_91e59d6c54de41a5a752a2e1fd1f6e39 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641877 24889 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.642391 24888 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.642829 24879 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.643170 24891 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.643181 24873 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ebc744ebb12d4dd498ca3721c3b9ac6a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
*** Check failure stack trace: ***
W20261120 09:08:27.643620 24864 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.23.79.126:41659)
    @     0x7fd861ecc980 (unknown) at ??:0
F20261120 09:08:27.635496 24885 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635813 24890 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635850 24872 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3e4fc42431704219b0f8051a3136c83a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.635896 24895 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.636992 24880 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638324 24869 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2db1fa040e8a4eae9a2eaa62637fb6eb on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638418 24876 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f2fb9ef502034f008e49c58af534c051 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638530 24883 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638593 24874 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a01c7b2bf886427c8666dcf79bf881e8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.638705 24875 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5a5b000e118f464abb0a40c93d617f59 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.640789 24871 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3fd14a71eb6b4a6c88dbaf4a470f6361 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641155 24884 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641162 24881 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641517 24882 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641564 24886 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641530 24878 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_91e59d6c54de41a5a752a2e1fd1f6e39 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.641877 24889 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.642391 24888 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.642829 24879 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.643170 24891 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.643181 24873 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ebc744ebb12d4dd498ca3721c3b9ac6a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)F20261120 09:08:27.644960 24887 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.23.79.126:41659,127.23.79.125:45319,127.23.79.124:33881, num_attempts: 738) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.23.79.126:41659: connect: Connection refused (error 111)
*** Check failure stack trace: ***
    @     0x7fd85ac32e87 gsignal at ??:0
    @     0x7fd85ac347f1 abort at ??:0
    @     0x7fd85d981d5d google::LogMessage::Fail() at ??:0
    @     0x7fd85d985b23 google::LogMessage::SendToLog() at ??:0
    @     0x7fd85d98175c google::LogMessage::Flush() at ??:0
I20261120 09:08:27.650372 26114 maintenance_manager.cc:419] P d82bf27d60fa450e8f941d1a9d36a825: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 3552 bytes on disk
    @     0x7fd85d982ee9 google::LogMessageFatal::~LogMessageFatal() at ??:0
    @           0x40b995 kudu::MasterStressTest::ReplaceTabletThread() at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/master-stress-test.cc:393
    @           0x447944 std::__invoke_impl<>() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/invoke.h:73
    @           0x4477fd std::__invoke<>() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/invoke.h:95
    @           0x4477ba _ZNSt6thread8_InvokerISt5tupleIJMN4kudu16MasterStressTestEFvvEPNS2_26MasterStressTest_Test_TestEEEE9_M_invokeIJLm0ELm1EEEEDTclsr3stdE8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:234
    @           0x44776e std::thread::_Invoker<>::operator()() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:243
    @           0x4474a9 std::thread::_State_impl<>::_M_run() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:186
I20261120 09:08:27.656150 26113 maintenance_manager.cc:643] P d82bf27d60fa450e8f941d1a9d36a825: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.005s	user 0.005s	sys 0.000s Metrics: {"dirs.queue_time_us":444,"dirs.run_cpu_time_us":100,"dirs.run_wall_time_us":100,"thread_start_us":545,"threads_started":2,"wal-append.queue_time_us":313}
    @     0x7fd85b2bc6df (unknown) at ??:0
    @     0x7fd861ec16db start_thread at ??:0
    @     0x7fd85ad1561f clone at ??:0