Note: This is test shard 3 of 3.
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/2
2026-08-08T19:59:48Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-08T19:59:48Z Disabled control of system clock
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskNcG5N9/thirdparty/installed/common/opt/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskNcG5N9/thirdparty/installed/common/opt/hadoop/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL: jdbc:derby:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/metadb;create=true
Metastore Connection Driver : org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User: APP
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.derby.sql
Initialization script completed
schemaTool completed
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/security.properties
2026-08-08 19:59:55: Starting Hive Metastore Server
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskNcG5N9/thirdparty/installed/common/opt/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskNcG5N9/thirdparty/installed/common/opt/hadoop/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Starting hive metastore on port 0
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260808 20:00:04.339790 21649 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu
/tmp/dist-test-taskNcG5N9/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.36.126:43945
--webserver_interface=127.21.36.126
--webserver_port=0
--builtin_ntp_servers=127.21.36.84:34883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593
--hive_metastore_uris=thrift://127.0.0.1:44789
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260808 20:00:04.707101 22116 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 20:00:04.707556 22116 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 20:00:04.707676 22116 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260808 20:00:04.716310 22116 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 20:00:04.716430 22116 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260808 20:00:04.716512 22116 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 20:00:04.716578 22116 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260808 20:00:04.727216 22116 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.36.84:34883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:44789
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.36.126:43945
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.36.126
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 08 Aug 2026 19:43:23 UTC on bdcb31816ec0
build id 13246
ASAN enabled
I20260808 20:00:04.729005 22116 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 20:00:04.731017 22116 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 20:00:04.741240 22137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 20:00:04.741194 22131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 20:00:04.741129 22127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 20:00:04.741386 22116 server_base.cc:1061] running on GCE node
I20260808 20:00:04.742513 22116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 20:00:04.744344 22116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 20:00:04.745611 22116 hybrid_clock.cc:648] HybridClock initialized: now 1786219204745570 us; error 110 us; skew 500 ppm
I20260808 20:00:04.746047 22116 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 20:00:04.748919 22116 webserver.cc:533] Webserver started at http://127.21.36.126:37243/ using document root <none> and password file <none>
I20260808 20:00:04.749730 22116 fs_manager.cc:362] Metadata directory not provided
I20260808 20:00:04.749850 22116 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 20:00:04.750166 22116 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 20:00:04.752941 22116 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data/instance:
uuid: "d2c4576401a74a60855647c956b195fd"
format_stamp: "Formatted at 2026-08-08 20:00:04 on dist-test-slave-pww0"
I20260808 20:00:04.753829 22116 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/wal/instance:
uuid: "d2c4576401a74a60855647c956b195fd"
format_stamp: "Formatted at 2026-08-08 20:00:04 on dist-test-slave-pww0"
I20260808 20:00:04.760123 22116 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 20:00:04.764467 22146 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 20:00:04.766232 22116 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 20:00:04.766445 22116 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data,/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/wal
uuid: "d2c4576401a74a60855647c956b195fd"
format_stamp: "Formatted at 2026-08-08 20:00:04 on dist-test-slave-pww0"
I20260808 20:00:04.766686 22116 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 20:00:04.782933 22116 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 20:00:04.783974 22116 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 20:00:04.784276 22116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 20:00:04.805955 22116 rpc_server.cc:307] RPC server started. Bound to: 127.21.36.126:43945
I20260808 20:00:04.805975 22231 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.36.126:43945 every 8 connection(s)
I20260808 20:00:04.807926 22116 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data/info.pb
I20260808 20:00:04.812601 22234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:04.814182 21649 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu as pid 22116
I20260808 20:00:04.814527 21649 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/wal/instance
I20260808 20:00:04.818179 21649 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu
/tmp/dist-test-taskNcG5N9/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.36.125:36441
--webserver_interface=127.21.36.125
--webserver_port=0
--builtin_ntp_servers=127.21.36.84:34883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593
--hive_metastore_uris=thrift://127.0.0.1:44789
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260808 20:00:04.821486 22234 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } has no permanent_uuid. Determining permanent_uuid...
I20260808 20:00:04.839738 22234 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } has no permanent_uuid. Determining permanent_uuid...
W20260808 20:00:04.841039 22150 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
W20260808 20:00:04.842734 22234 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.125:36441: Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
I20260808 20:00:04.892092 22234 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } attempt: 1
W20260808 20:00:04.894265 22234 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.125:36441: Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
I20260808 20:00:04.962586 22234 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } attempt: 2
W20260808 20:00:04.964715 22234 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.125:36441: Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
I20260808 20:00:05.056027 22234 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } attempt: 3
W20260808 20:00:05.058092 22234 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.125:36441: Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
W20260808 20:00:05.187793 22236 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 20:00:05.188184 22236 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 20:00:05.188299 22236 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260808 20:00:05.197065 22236 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 20:00:05.197192 22236 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260808 20:00:05.197283 22236 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 20:00:05.197348 22236 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260808 20:00:05.201401 22234 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } attempt: 4
W20260808 20:00:05.203749 22234 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.125:36441: Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
I20260808 20:00:05.208305 22236 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.36.84:34883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:44789
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.36.125:36441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.21.36.125
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 08 Aug 2026 19:43:23 UTC on bdcb31816ec0
build id 13246
ASAN enabled
I20260808 20:00:05.210088 22236 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 20:00:05.212183 22236 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 20:00:05.222033 22245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 20:00:05.222065 22248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 20:00:05.222119 22246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 20:00:05.222535 22236 server_base.cc:1061] running on GCE node
I20260808 20:00:05.223737 22236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 20:00:05.225338 22236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 20:00:05.226565 22236 hybrid_clock.cc:648] HybridClock initialized: now 1786219205226492 us; error 66 us; skew 500 ppm
I20260808 20:00:05.227079 22236 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 20:00:05.229825 22236 webserver.cc:533] Webserver started at http://127.21.36.125:38063/ using document root <none> and password file <none>
I20260808 20:00:05.230743 22236 fs_manager.cc:362] Metadata directory not provided
I20260808 20:00:05.230880 22236 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 20:00:05.231292 22236 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 20:00:05.236476 22236 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/data/instance:
uuid: "16a59d796024414abf9f82a7593530a6"
format_stamp: "Formatted at 2026-08-08 20:00:05 on dist-test-slave-pww0"
I20260808 20:00:05.237468 22236 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/wal/instance:
uuid: "16a59d796024414abf9f82a7593530a6"
format_stamp: "Formatted at 2026-08-08 20:00:05 on dist-test-slave-pww0"
I20260808 20:00:05.243882 22236 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 20:00:05.248697 22263 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 20:00:05.250602 22236 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 20:00:05.250828 22236 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/data,/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/wal
uuid: "16a59d796024414abf9f82a7593530a6"
format_stamp: "Formatted at 2026-08-08 20:00:05 on dist-test-slave-pww0"
I20260808 20:00:05.251065 22236 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 20:00:05.268325 22236 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 20:00:05.269443 22236 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 20:00:05.269762 22236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 20:00:05.292569 22343 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.36.125:36441 every 8 connection(s)
I20260808 20:00:05.292629 22236 rpc_server.cc:307] RPC server started. Bound to: 127.21.36.125:36441
I20260808 20:00:05.294484 22236 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/data/info.pb
I20260808 20:00:05.299871 22344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:05.302989 21649 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu as pid 22236
I20260808 20:00:05.303203 21649 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/wal/instance
I20260808 20:00:05.304461 21649 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu
/tmp/dist-test-taskNcG5N9/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.36.124:34593
--webserver_interface=127.21.36.124
--webserver_port=0
--builtin_ntp_servers=127.21.36.84:34883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593
--hive_metastore_uris=thrift://127.0.0.1:44789
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260808 20:00:05.306793 22344 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } has no permanent_uuid. Determining permanent_uuid...
I20260808 20:00:05.321895 22344 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } has no permanent_uuid. Determining permanent_uuid...
I20260808 20:00:05.332844 22344 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } has no permanent_uuid. Determining permanent_uuid...
W20260808 20:00:05.334401 22267 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:00:05.336472 22344 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.124:34593: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:00:05.385881 22344 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } attempt: 1
W20260808 20:00:05.388043 22344 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.124:34593: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:00:05.456323 22344 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } attempt: 2
W20260808 20:00:05.458418 22344 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.124:34593: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:00:05.503052 22234 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } attempt: 5
I20260808 20:00:05.510313 22234 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } has no permanent_uuid. Determining permanent_uuid...
W20260808 20:00:05.513273 22234 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.124:34593: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:00:05.549695 22344 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } attempt: 3
W20260808 20:00:05.551832 22344 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.124:34593: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:00:05.564543 22234 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } attempt: 1
W20260808 20:00:05.566679 22234 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.124:34593: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:00:05.634941 22234 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } attempt: 2
W20260808 20:00:05.637365 22234 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.124:34593: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:00:05.672914 22346 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 20:00:05.673288 22346 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 20:00:05.673401 22346 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260808 20:00:05.682231 22346 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 20:00:05.682355 22346 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260808 20:00:05.682439 22346 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 20:00:05.682503 22346 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260808 20:00:05.693279 22346 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.36.84:34883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:44789
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.36.124:34593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.21.36.124
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 08 Aug 2026 19:43:23 UTC on bdcb31816ec0
build id 13246
ASAN enabled
I20260808 20:00:05.695007 22346 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 20:00:05.695089 22344 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } attempt: 4
W20260808 20:00:05.697027 22344 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.124:34593: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:00:05.697124 22346 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 20:00:05.706076 22356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 20:00:05.706055 22357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 20:00:05.706828 22362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 20:00:05.707290 22346 server_base.cc:1061] running on GCE node
I20260808 20:00:05.708168 22346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 20:00:05.709851 22346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 20:00:05.711076 22346 hybrid_clock.cc:648] HybridClock initialized: now 1786219205711019 us; error 59 us; skew 500 ppm
I20260808 20:00:05.711500 22346 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 20:00:05.713867 22346 webserver.cc:533] Webserver started at http://127.21.36.124:40825/ using document root <none> and password file <none>
I20260808 20:00:05.714668 22346 fs_manager.cc:362] Metadata directory not provided
I20260808 20:00:05.714800 22346 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 20:00:05.715168 22346 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 20:00:05.717792 22346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/data/instance:
uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979"
format_stamp: "Formatted at 2026-08-08 20:00:05 on dist-test-slave-pww0"
I20260808 20:00:05.718640 22346 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/wal/instance:
uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979"
format_stamp: "Formatted at 2026-08-08 20:00:05 on dist-test-slave-pww0"
I20260808 20:00:05.724802 22346 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260808 20:00:05.728822 22371 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 20:00:05.730473 22346 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 20:00:05.730667 22346 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/data,/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/wal
uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979"
format_stamp: "Formatted at 2026-08-08 20:00:05 on dist-test-slave-pww0"
I20260808 20:00:05.730917 22346 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 20:00:05.743602 22234 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } attempt: 3
W20260808 20:00:05.745921 22234 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.124:34593: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:00:05.749521 22346 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 20:00:05.750563 22346 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 20:00:05.750844 22346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 20:00:05.771770 22452 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.36.124:34593 every 8 connection(s)
I20260808 20:00:05.771790 22346 rpc_server.cc:307] RPC server started. Bound to: 127.21.36.124:34593
I20260808 20:00:05.773638 22346 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/data/info.pb
I20260808 20:00:05.778409 22453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:05.778988 21649 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu as pid 22346
I20260808 20:00:05.779168 21649 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/wal/instance
I20260808 20:00:05.785660 22453 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } has no permanent_uuid. Determining permanent_uuid...
I20260808 20:00:05.819118 22453 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } has no permanent_uuid. Determining permanent_uuid...
I20260808 20:00:05.826958 22453 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } has no permanent_uuid. Determining permanent_uuid...
I20260808 20:00:05.837628 22453 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: Bootstrap starting.
I20260808 20:00:05.841107 22453 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:05.842664 22453 log.cc:826] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: Log is configured to *not* fsync() on all Append() calls
I20260808 20:00:05.845657 22453 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: No bootstrap required, opened a new log
I20260808 20:00:05.851640 22453 raft_consensus.cc:359] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:05.852000 22453 raft_consensus.cc:385] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:05.852138 22453 raft_consensus.cc:740] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b91a1a84d6cd4038ac9d3ad2b8cf7979, State: Initialized, Role: FOLLOWER
I20260808 20:00:05.852845 22453 consensus_queue.cc:260] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:05.853873 22463 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:05.854132 22463 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:05.854918 22453 sys_catalog.cc:565] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 20:00:05.868160 22488 catalog_manager.cc:1594] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 20:00:05.868322 22488 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 20:00:05.864054 22346 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: OK, instance_id { permanent_uuid: "d2c4576401a74a60855647c956b195fd" instance_seqno: 1786219204799976 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 20:00:05.870422 22346 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:00:05.923173 22234 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } attempt: 4
I20260808 20:00:05.938994 22234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Bootstrap starting.
I20260808 20:00:05.943842 22234 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:05.945508 22234 log.cc:826] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Log is configured to *not* fsync() on all Append() calls
I20260808 20:00:05.949842 22234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: No bootstrap required, opened a new log
I20260808 20:00:05.958814 22234 raft_consensus.cc:359] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:05.959249 22234 raft_consensus.cc:385] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:05.959393 22234 raft_consensus.cc:740] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2c4576401a74a60855647c956b195fd, State: Initialized, Role: FOLLOWER
I20260808 20:00:05.960243 22234 consensus_queue.cc:260] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:05.964469 22494 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:05.964967 22494 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:05.966163 22234 sys_catalog.cc:565] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 20:00:05.978263 22116 master_runner.cc:187] Error getting master registration for 127.21.36.125:36441: OK, instance_id { permanent_uuid: "16a59d796024414abf9f82a7593530a6" instance_seqno: 1786219205286351 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 20:00:05.986471 22116 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:00:05.991417 22516 catalog_manager.cc:1594] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 20:00:05.991644 22516 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 20:00:05.996268 22344 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } attempt: 5
W20260808 20:00:06.003336 22383 tablet.cc:2406] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 20:00:06.009799 22344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6: Bootstrap starting.
I20260808 20:00:06.014716 22344 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:06.016480 22344 log.cc:826] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6: Log is configured to *not* fsync() on all Append() calls
I20260808 20:00:06.022889 22344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6: No bootstrap required, opened a new log
I20260808 20:00:06.031518 22344 raft_consensus.cc:359] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:06.031968 22344 raft_consensus.cc:385] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:06.032112 22344 raft_consensus.cc:740] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16a59d796024414abf9f82a7593530a6, State: Initialized, Role: FOLLOWER
I20260808 20:00:06.033010 22344 consensus_queue.cc:260] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:06.036376 22526 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:06.036868 22526 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 20:00:06.037598 22158 tablet.cc:2406] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 20:00:06.038089 22344 sys_catalog.cc:565] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 20:00:06.073782 22236 master_runner.cc:264] No leader master found from master 16a59d796024414abf9f82a7593530a6
I20260808 20:00:06.073936 22236 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:00:06.086624 22549 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 20:00:06.086946 22549 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 20:00:06.128518 22463 raft_consensus.cc:493] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:06.128897 22463 raft_consensus.cc:515] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:06.131060 22463 leader_election.cc:290] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441)
I20260808 20:00:06.132670 22302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16a59d796024414abf9f82a7593530a6" is_pre_election: true
I20260808 20:00:06.133308 22302 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b91a1a84d6cd4038ac9d3ad2b8cf7979 in term 0.
I20260808 20:00:06.134541 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2c4576401a74a60855647c956b195fd" is_pre_election: true
I20260808 20:00:06.134720 22378 leader_election.cc:304] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16a59d796024414abf9f82a7593530a6, b91a1a84d6cd4038ac9d3ad2b8cf7979; no voters:
I20260808 20:00:06.135111 22188 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b91a1a84d6cd4038ac9d3ad2b8cf7979 in term 0.
I20260808 20:00:06.135416 22463 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:06.136384 22463 raft_consensus.cc:493] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:06.136617 22463 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:06.140532 22463 raft_consensus.cc:515] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:06.142246 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2c4576401a74a60855647c956b195fd"
I20260808 20:00:06.142531 22188 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:06.142999 22302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16a59d796024414abf9f82a7593530a6"
I20260808 20:00:06.143247 22302 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:06.146422 22188 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b91a1a84d6cd4038ac9d3ad2b8cf7979 in term 1.
I20260808 20:00:06.147364 22380 leader_election.cc:304] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd; no voters:
I20260808 20:00:06.152786 22302 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b91a1a84d6cd4038ac9d3ad2b8cf7979 in term 1.
I20260808 20:00:06.160949 22463 leader_election.cc:290] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 1 election: Requested vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441)
I20260808 20:00:06.161883 22463 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:06.162497 22463 raft_consensus.cc:697] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 1 LEADER]: Becoming Leader. State: Replica: b91a1a84d6cd4038ac9d3ad2b8cf7979, State: Running, Role: LEADER
I20260808 20:00:06.163353 22463 consensus_queue.cc:237] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:06.174077 22555 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b91a1a84d6cd4038ac9d3ad2b8cf7979. Latest consensus state: current_term: 1 leader_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:06.174697 22555 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: This master's current role is: LEADER
I20260808 20:00:06.182890 22562 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 20:00:06.185667 22562 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 20:00:06.203017 22302 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 1 FOLLOWER]: Refusing update from remote peer b91a1a84d6cd4038ac9d3ad2b8cf7979: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 20:00:06.204560 22555 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:06.216296 22188 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 1 FOLLOWER]: Refusing update from remote peer b91a1a84d6cd4038ac9d3ad2b8cf7979: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 20:00:06.217507 22555 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:06.236850 22526 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b91a1a84d6cd4038ac9d3ad2b8cf7979. Latest consensus state: current_term: 1 leader_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:06.237170 22526 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:06.241410 22563 mvcc.cc:204] Tried to move back new op lower bound from 7316353868592570368 to 7316353868460281856. Current Snapshot: MvccSnapshot[applied={T|T < 7316353868592570368}]
I20260808 20:00:06.244922 22564 mvcc.cc:204] Tried to move back new op lower bound from 7316353868592570368 to 7316353868460281856. Current Snapshot: MvccSnapshot[applied={T|T < 7316353868592570368}]
I20260808 20:00:06.253422 22463 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:06.253768 22463 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: This master's current role is: LEADER
I20260808 20:00:06.255115 22494 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader b91a1a84d6cd4038ac9d3ad2b8cf7979. Latest consensus state: current_term: 1 leader_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:06.255307 22562 catalog_manager.cc:1383] Generated new cluster ID: 9c4ad126d38943188e9e4422f5e27418
I20260808 20:00:06.255419 22494 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:06.255439 22562 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 20:00:06.259922 22526 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:06.260190 22526 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:06.263062 22565 mvcc.cc:204] Tried to move back new op lower bound from 7316353868592570368 to 7316353868460281856. Current Snapshot: MvccSnapshot[applied={T|T < 7316353868592570368}]
I20260808 20:00:06.281268 22494 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:06.281534 22494 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:06.282977 22574 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:06.283443 22574 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: This master's current role is: LEADER
I20260808 20:00:06.298803 22562 catalog_manager.cc:1406] Generated new certificate authority record
I20260808 20:00:06.301049 22562 catalog_manager.cc:1540] Loading token signing keys...
I20260808 20:00:06.344473 22562 catalog_manager.cc:6092] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: Generated new TSK 0
I20260808 20:00:06.345767 22562 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 20:00:06.347285 22562 catalog_manager.cc:1563] Loading latest processed Hive Metastore notification log event ID...
I20260808 20:00:06.348685 22562 catalog_manager.cc:5941] Last processed Hive Metastore notification event ID: -1
I20260808 20:00:06.376725 21649 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu
/tmp/dist-test-taskNcG5N9/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.36.65:0
--local_ip_for_outbound_sockets=127.21.36.65
--webserver_interface=127.21.36.65
--webserver_port=0
--tserver_master_addrs=127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593
--builtin_ntp_servers=127.21.36.84:34883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260808 20:00:06.954739 22580 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 20:00:06.955124 22580 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 20:00:06.955253 22580 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260808 20:00:06.964584 22580 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260808 20:00:06.964833 22580 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.36.65
I20260808 20:00:06.975692 22580 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.36.84:34883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.36.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.36.65
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.36.65
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 08 Aug 2026 19:43:23 UTC on bdcb31816ec0
build id 13246
ASAN enabled
I20260808 20:00:06.977507 22580 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 20:00:06.979525 22580 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 20:00:06.990048 22589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 20:00:06.990059 22590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 20:00:06.990656 22592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 20:00:06.991988 22580 server_base.cc:1061] running on GCE node
I20260808 20:00:06.992578 22580 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 20:00:06.993795 22580 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 20:00:06.994801 22516 catalog_manager.cc:1295] Loaded cluster ID: 9c4ad126d38943188e9e4422f5e27418
I20260808 20:00:06.994890 22516 catalog_manager.cc:1588] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: loading cluster ID for follower catalog manager: success
I20260808 20:00:06.995057 22580 hybrid_clock.cc:648] HybridClock initialized: now 1786219206994996 us; error 54 us; skew 500 ppm
I20260808 20:00:06.995401 22580 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 20:00:06.997859 22516 catalog_manager.cc:1610] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: acquiring CA information for follower catalog manager: success
I20260808 20:00:06.998298 22580 webserver.cc:533] Webserver started at http://127.21.36.65:40373/ using document root <none> and password file <none>
I20260808 20:00:06.999140 22580 fs_manager.cc:362] Metadata directory not provided
I20260808 20:00:06.999271 22580 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 20:00:06.999703 22580 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 20:00:07.000027 22516 catalog_manager.cc:1638] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 20:00:07.002419 22580 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-0/data/instance:
uuid: "257c9c7e0c6c441593eac06beb31fa4e"
format_stamp: "Formatted at 2026-08-08 20:00:06 on dist-test-slave-pww0"
I20260808 20:00:07.003343 22580 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-0/wal/instance:
uuid: "257c9c7e0c6c441593eac06beb31fa4e"
format_stamp: "Formatted at 2026-08-08 20:00:06 on dist-test-slave-pww0"
I20260808 20:00:07.009768 22580 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260808 20:00:07.014629 22603 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 20:00:07.017102 22580 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260808 20:00:07.017405 22580 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-0/wal
uuid: "257c9c7e0c6c441593eac06beb31fa4e"
format_stamp: "Formatted at 2026-08-08 20:00:06 on dist-test-slave-pww0"
I20260808 20:00:07.017711 22580 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 20:00:07.035323 22580 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 20:00:07.036365 22580 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 20:00:07.036654 22580 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 20:00:07.037740 22580 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 20:00:07.039737 22580 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 20:00:07.039839 22580 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 20:00:07.039968 22580 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 20:00:07.040038 22580 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 20:00:07.073698 22580 rpc_server.cc:307] RPC server started. Bound to: 127.21.36.65:39923
I20260808 20:00:07.073758 22789 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.36.65:39923 every 8 connection(s)
I20260808 20:00:07.075271 22580 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-0/data/info.pb
I20260808 20:00:07.076076 21649 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu as pid 22580
I20260808 20:00:07.076344 21649 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-0/wal/instance
I20260808 20:00:07.089838 22549 catalog_manager.cc:1295] Loaded cluster ID: 9c4ad126d38943188e9e4422f5e27418
I20260808 20:00:07.089990 22549 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6: loading cluster ID for follower catalog manager: success
I20260808 20:00:07.092394 21649 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu
/tmp/dist-test-taskNcG5N9/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.36.66:0
--local_ip_for_outbound_sockets=127.21.36.66
--webserver_interface=127.21.36.66
--webserver_port=0
--tserver_master_addrs=127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593
--builtin_ntp_servers=127.21.36.84:34883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260808 20:00:07.094583 22549 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6: acquiring CA information for follower catalog manager: success
I20260808 20:00:07.098061 22549 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 20:00:07.134217 22794 heartbeater.cc:344] Connected to a master server at 127.21.36.126:43945
I20260808 20:00:07.134337 22791 heartbeater.cc:344] Connected to a master server at 127.21.36.124:34593
I20260808 20:00:07.134725 22791 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:07.134713 22794 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:07.134884 22796 heartbeater.cc:344] Connected to a master server at 127.21.36.125:36441
I20260808 20:00:07.135030 22796 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:07.136210 22796 heartbeater.cc:507] Master 127.21.36.125:36441 requested a full tablet report, sending...
I20260808 20:00:07.136236 22794 heartbeater.cc:507] Master 127.21.36.126:43945 requested a full tablet report, sending...
I20260808 20:00:07.136740 22791 heartbeater.cc:507] Master 127.21.36.124:34593 requested a full tablet report, sending...
I20260808 20:00:07.138969 22176 ts_manager.cc:194] Registered new tserver with Master: 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923)
I20260808 20:00:07.139165 22288 ts_manager.cc:194] Registered new tserver with Master: 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923)
I20260808 20:00:07.140758 22397 ts_manager.cc:194] Registered new tserver with Master: 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923)
I20260808 20:00:07.143052 22397 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.36.65:57821
I20260808 20:00:07.232352 22806 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:00:07.232599 22806 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:07.234452 22806 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
I20260808 20:00:07.234979 22411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "16a59d796024414abf9f82a7593530a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" is_pre_election: true
I20260808 20:00:07.235349 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "16a59d796024414abf9f82a7593530a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d2c4576401a74a60855647c956b195fd" is_pre_election: true
I20260808 20:00:07.236079 22267 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:00:07.236550 22806 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:00:07.476176 22804 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 20:00:07.476536 22804 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 20:00:07.476662 22804 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260808 20:00:07.485400 22804 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260808 20:00:07.485621 22804 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.36.66
I20260808 20:00:07.496537 22804 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.36.84:34883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.36.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.36.66
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.36.66
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 08 Aug 2026 19:43:23 UTC on bdcb31816ec0
build id 13246
ASAN enabled
I20260808 20:00:07.498297 22804 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 20:00:07.500304 22804 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 20:00:07.511035 22815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 20:00:07.511183 22812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 20:00:07.512132 22818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 20:00:07.513327 22804 server_base.cc:1061] running on GCE node
I20260808 20:00:07.514035 22804 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 20:00:07.515161 22804 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 20:00:07.516393 22804 hybrid_clock.cc:648] HybridClock initialized: now 1786219207516315 us; error 74 us; skew 500 ppm
I20260808 20:00:07.516755 22804 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 20:00:07.519759 22804 webserver.cc:533] Webserver started at http://127.21.36.66:40223/ using document root <none> and password file <none>
I20260808 20:00:07.520843 22804 fs_manager.cc:362] Metadata directory not provided
I20260808 20:00:07.520962 22804 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 20:00:07.521327 22804 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 20:00:07.524173 22804 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/data/instance:
uuid: "e34d5caee97d44fa945a91ddc6a54653"
format_stamp: "Formatted at 2026-08-08 20:00:07 on dist-test-slave-pww0"
I20260808 20:00:07.525096 22804 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/wal/instance:
uuid: "e34d5caee97d44fa945a91ddc6a54653"
format_stamp: "Formatted at 2026-08-08 20:00:07 on dist-test-slave-pww0"
I20260808 20:00:07.531316 22804 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 20:00:07.535338 22829 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 20:00:07.537042 22804 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 20:00:07.537252 22804 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/wal
uuid: "e34d5caee97d44fa945a91ddc6a54653"
format_stamp: "Formatted at 2026-08-08 20:00:07 on dist-test-slave-pww0"
I20260808 20:00:07.537519 22804 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 20:00:07.566412 22804 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 20:00:07.567528 22804 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 20:00:07.567900 22804 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 20:00:07.569058 22804 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 20:00:07.571208 22804 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 20:00:07.571336 22804 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 20:00:07.571494 22804 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 20:00:07.571583 22804 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260808 20:00:07.608021 22804 rpc_server.cc:307] RPC server started. Bound to: 127.21.36.66:46229
I20260808 20:00:07.608065 23015 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.36.66:46229 every 8 connection(s)
I20260808 20:00:07.609772 22804 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/data/info.pb
I20260808 20:00:07.613590 21649 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu as pid 22804
I20260808 20:00:07.613751 21649 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/wal/instance
I20260808 20:00:07.618925 21649 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu
/tmp/dist-test-taskNcG5N9/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.36.67:0
--local_ip_for_outbound_sockets=127.21.36.67
--webserver_interface=127.21.36.67
--webserver_port=0
--tserver_master_addrs=127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593
--builtin_ntp_servers=127.21.36.84:34883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260808 20:00:07.631991 23019 heartbeater.cc:344] Connected to a master server at 127.21.36.125:36441
I20260808 20:00:07.632028 23017 heartbeater.cc:344] Connected to a master server at 127.21.36.126:43945
I20260808 20:00:07.632464 23019 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:07.632460 23017 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:07.633294 23016 heartbeater.cc:344] Connected to a master server at 127.21.36.124:34593
I20260808 20:00:07.633445 23016 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:07.633802 23017 heartbeater.cc:507] Master 127.21.36.126:43945 requested a full tablet report, sending...
I20260808 20:00:07.633929 23016 heartbeater.cc:507] Master 127.21.36.124:34593 requested a full tablet report, sending...
I20260808 20:00:07.635372 23019 heartbeater.cc:507] Master 127.21.36.125:36441 requested a full tablet report, sending...
I20260808 20:00:07.636345 22176 ts_manager.cc:194] Registered new tserver with Master: e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:07.636431 22397 ts_manager.cc:194] Registered new tserver with Master: e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:07.637203 22288 ts_manager.cc:194] Registered new tserver with Master: e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:07.637550 22397 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.36.66:39663
I20260808 20:00:07.646384 22791 heartbeater.cc:499] Master 127.21.36.124:34593 was elected leader, sending a full tablet report...
I20260808 20:00:07.736245 23028 raft_consensus.cc:493] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:00:07.736510 23028 raft_consensus.cc:515] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:07.738250 23028 leader_election.cc:290] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
I20260808 20:00:07.738924 22301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d2c4576401a74a60855647c956b195fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "16a59d796024414abf9f82a7593530a6" is_pre_election: true
I20260808 20:00:07.739359 22411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d2c4576401a74a60855647c956b195fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" is_pre_election: true
I20260808 20:00:07.740177 22151 leader_election.cc:304] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2c4576401a74a60855647c956b195fd; no voters: 16a59d796024414abf9f82a7593530a6, b91a1a84d6cd4038ac9d3ad2b8cf7979
I20260808 20:00:07.740792 23028 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:00:07.791862 23029 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:00:07.792107 23029 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:07.793643 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "16a59d796024414abf9f82a7593530a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d2c4576401a74a60855647c956b195fd" is_pre_election: true
I20260808 20:00:07.793740 22411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "16a59d796024414abf9f82a7593530a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" is_pre_election: true
I20260808 20:00:07.793965 22188 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16a59d796024414abf9f82a7593530a6 in term 1.
I20260808 20:00:07.794634 23029 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
I20260808 20:00:07.794737 22268 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16a59d796024414abf9f82a7593530a6, d2c4576401a74a60855647c956b195fd; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979
I20260808 20:00:07.795248 23029 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 20:00:07.795429 23029 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:00:07.795578 23029 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 1 FOLLOWER]: Advancing to term 2
I20260808 20:00:07.799091 23029 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:07.800768 22188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "16a59d796024414abf9f82a7593530a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d2c4576401a74a60855647c956b195fd"
I20260808 20:00:07.800839 22411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "16a59d796024414abf9f82a7593530a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979"
I20260808 20:00:07.801079 22188 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 1 FOLLOWER]: Advancing to term 2
I20260808 20:00:07.801826 23029 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 2 election: Requested vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
I20260808 20:00:07.804493 22188 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16a59d796024414abf9f82a7593530a6 in term 2.
I20260808 20:00:07.805160 22268 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16a59d796024414abf9f82a7593530a6, d2c4576401a74a60855647c956b195fd; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979
I20260808 20:00:07.805579 23029 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 20:00:07.806294 23029 raft_consensus.cc:697] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 2 LEADER]: Becoming Leader. State: Replica: 16a59d796024414abf9f82a7593530a6, State: Running, Role: LEADER
I20260808 20:00:07.806994 23029 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:07.809415 23031 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16a59d796024414abf9f82a7593530a6. Latest consensus state: current_term: 2 leader_uuid: "16a59d796024414abf9f82a7593530a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:07.809763 23031 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: This master's current role is: LEADER
I20260808 20:00:07.810756 23033 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 20:00:07.813807 23033 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 20:00:07.815172 23033 catalog_manager.cc:1295] Loaded cluster ID: 9c4ad126d38943188e9e4422f5e27418
I20260808 20:00:07.815302 23033 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 20:00:07.816992 23033 catalog_manager.cc:1540] Loading token signing keys...
I20260808 20:00:07.818148 23033 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6: Loaded TSK: 0
I20260808 20:00:07.819443 23033 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 20:00:07.820591 23033 catalog_manager.cc:1563] Loading latest processed Hive Metastore notification log event ID...
I20260808 20:00:07.821617 23033 catalog_manager.cc:5941] Last processed Hive Metastore notification event ID: -1
I20260808 20:00:07.850142 22188 raft_consensus.cc:1240] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 2 FOLLOWER]: Rejecting Update request from peer b91a1a84d6cd4038ac9d3ad2b8cf7979 for earlier term 1. Current term is 2. Ops: []
I20260808 20:00:07.851204 23030 consensus_queue.cc:1059] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260808 20:00:07.855145 23037 raft_consensus.cc:3055] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 1 LEADER]: Stepping down as leader of term 1
I20260808 20:00:07.855296 23037 raft_consensus.cc:740] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b91a1a84d6cd4038ac9d3ad2b8cf7979, State: Running, Role: LEADER
I20260808 20:00:07.855856 23037 consensus_queue.cc:260] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:07.856544 23037 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 1 FOLLOWER]: Advancing to term 2
I20260808 20:00:07.873348 22488 catalog_manager.cc:1638] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 20:00:08.010538 23027 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 20:00:08.010917 23027 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 20:00:08.011054 23027 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260808 20:00:08.019879 23027 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260808 20:00:08.020107 23027 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.36.67
I20260808 20:00:08.030990 23027 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.36.84:34883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.36.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.36.67
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.36.67
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 08 Aug 2026 19:43:23 UTC on bdcb31816ec0
build id 13246
ASAN enabled
I20260808 20:00:08.032759 23027 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 20:00:08.034842 23027 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 20:00:08.045549 23044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 20:00:08.045567 23043 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 20:00:08.046170 23046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 20:00:08.047894 23027 server_base.cc:1061] running on GCE node
I20260808 20:00:08.048601 23027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 20:00:08.049664 23027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 20:00:08.050906 23027 hybrid_clock.cc:648] HybridClock initialized: now 1786219208050807 us; error 78 us; skew 500 ppm
I20260808 20:00:08.051261 23027 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 20:00:08.053640 23027 webserver.cc:533] Webserver started at http://127.21.36.67:45941/ using document root <none> and password file <none>
I20260808 20:00:08.054453 23027 fs_manager.cc:362] Metadata directory not provided
I20260808 20:00:08.054567 23027 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 20:00:08.054926 23027 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 20:00:08.058240 23027 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/data/instance:
uuid: "5f6b6c2e318d44a984120a06a09e9af9"
format_stamp: "Formatted at 2026-08-08 20:00:08 on dist-test-slave-pww0"
I20260808 20:00:08.059389 23027 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/wal/instance:
uuid: "5f6b6c2e318d44a984120a06a09e9af9"
format_stamp: "Formatted at 2026-08-08 20:00:08 on dist-test-slave-pww0"
I20260808 20:00:08.066694 23027 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.005s sys 0.001s
I20260808 20:00:08.070652 23065 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 20:00:08.072327 23027 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 20:00:08.072518 23027 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/wal
uuid: "5f6b6c2e318d44a984120a06a09e9af9"
format_stamp: "Formatted at 2026-08-08 20:00:08 on dist-test-slave-pww0"
I20260808 20:00:08.072785 23027 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 20:00:08.101537 23027 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 20:00:08.102533 23027 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 20:00:08.102826 23027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 20:00:08.103883 23027 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 20:00:08.105741 23027 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 20:00:08.105845 23027 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 20:00:08.105965 23027 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 20:00:08.106040 23027 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 20:00:08.140599 23016 heartbeater.cc:499] Master 127.21.36.124:34593 was elected leader, sending a full tablet report...
I20260808 20:00:08.143226 23027 rpc_server.cc:307] RPC server started. Bound to: 127.21.36.67:43047
I20260808 20:00:08.143342 23253 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.36.67:43047 every 8 connection(s)
I20260808 20:00:08.145093 23027 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/data/info.pb
I20260808 20:00:08.153414 21649 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu as pid 23027
I20260808 20:00:08.153646 21649 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/wal/instance
I20260808 20:00:08.165174 23254 heartbeater.cc:344] Connected to a master server at 127.21.36.124:34593
I20260808 20:00:08.165465 23256 heartbeater.cc:344] Connected to a master server at 127.21.36.126:43945
I20260808 20:00:08.165741 23256 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:08.165745 23254 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:08.166882 23254 heartbeater.cc:507] Master 127.21.36.124:34593 requested a full tablet report, sending...
I20260808 20:00:08.168110 23256 heartbeater.cc:507] Master 127.21.36.126:43945 requested a full tablet report, sending...
I20260808 20:00:08.168924 22397 ts_manager.cc:194] Registered new tserver with Master: 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:08.169332 22176 ts_manager.cc:194] Registered new tserver with Master: 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:08.171190 23257 heartbeater.cc:344] Connected to a master server at 127.21.36.125:36441
I20260808 20:00:08.171360 23257 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:08.171881 23257 heartbeater.cc:507] Master 127.21.36.125:36441 requested a full tablet report, sending...
I20260808 20:00:08.172809 22288 ts_manager.cc:194] Registered new tserver with Master: 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:08.174147 22288 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.36.67:35067
I20260808 20:00:08.183128 21649 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260808 20:00:08.220568 22287 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38088:
name: "default.Table_f4c950a229114bde8c62335c66af32ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:08.221644 22285 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38088:
name: "default.Table_6ac9f69790254374990cc94411d04422"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:08.221787 22284 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38088:
name: "default.Table_b5f73af0927644749fde95d4e9e1bc95"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:08.222903 22283 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38088:
name: "default.Table_16d9fc25b3274923be16373085586742"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:08.223747 22282 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38088:
name: "default.Table_324c660111c84a72a6935eb8e30a7ae6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:08.224903 22278 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38088:
name: "default.Table_06f9bc92453b456293c74faba2798d3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:08.225147 22277 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38088:
name: "default.Table_b91802b5296a416490e52b3cb07d0519"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:08.225752 22275 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38088:
name: "default.Table_752d0310c94b42d3902fffa1070bb1d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:08.224440 22281 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38088:
name: "default.Table_831d17f2742e4fb8bc727d56fc9d1c85"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:08.220418 22288 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38088:
name: "default.Table_4dc166b247ee4cf89cdd926e07b51a51"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 20:00:08.249215 22278 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_06f9bc92453b456293c74faba2798d3b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260808 20:00:08.250747 22282 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_324c660111c84a72a6935eb8e30a7ae6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260808 20:00:08.252200 22277 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_b91802b5296a416490e52b3cb07d0519 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260808 20:00:08.253266 22283 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_16d9fc25b3274923be16373085586742 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260808 20:00:08.254292 22284 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_b5f73af0927644749fde95d4e9e1bc95 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260808 20:00:08.255254 22275 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_752d0310c94b42d3902fffa1070bb1d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260808 20:00:08.256363 22285 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_6ac9f69790254374990cc94411d04422 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260808 20:00:08.257766 22287 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_f4c950a229114bde8c62335c66af32ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 20:00:08.259124 21649 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu pid 22116
I20260808 20:00:08.260555 22225 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 20:00:08.376312 22411 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 2 FOLLOWER]: Refusing update from remote peer 16a59d796024414abf9f82a7593530a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260808 20:00:08.377278 23031 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260808 20:00:08.379925 23349 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16a59d796024414abf9f82a7593530a6. Latest consensus state: current_term: 2 leader_uuid: "16a59d796024414abf9f82a7593530a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:08.380467 23349 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:08.389379 23031 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "16a59d796024414abf9f82a7593530a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:08.389664 23031 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: This master's current role is: LEADER
I20260808 20:00:08.419646 23349 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "16a59d796024414abf9f82a7593530a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:08.419904 23349 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:08.430393 22188 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 2 FOLLOWER]: Refusing update from remote peer 16a59d796024414abf9f82a7593530a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260808 20:00:08.431757 21649 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu with pid 22116
I20260808 20:00:08.431730 23031 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260808 20:00:08.478281 22268 connection.cc:573] client connection to 127.21.36.126:43945 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 20:00:08.495394 22268 consensus_peers.cc:597] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 -> Peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Couldn't send request to peer d2c4576401a74a60855647c956b195fd. Status: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 20:00:08.641610 23019 heartbeater.cc:499] Master 127.21.36.125:36441 was elected leader, sending a full tablet report...
W20260808 20:00:08.643986 23017 heartbeater.cc:646] Failed to heartbeat to 127.21.36.126:43945 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:00:08.647914 22794 heartbeater.cc:646] Failed to heartbeat to 127.21.36.126:43945 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
I20260808 20:00:08.648872 22796 heartbeater.cc:499] Master 127.21.36.125:36441 was elected leader, sending a full tablet report...
I20260808 20:00:08.676927 23257 heartbeater.cc:499] Master 127.21.36.125:36441 was elected leader, sending a full tablet report...
W20260808 20:00:08.684644 23256 heartbeater.cc:646] Failed to heartbeat to 127.21.36.126:43945 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
I20260808 20:00:08.732838 22278 catalog_manager.cc:2200] created HMS catalog entry for table [id=53f52501c5e44774a011ce5d23f07528]
I20260808 20:00:08.760700 22278 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38088:
table { table_name: "default.Table_06f9bc92453b456293c74faba2798d3b" } new_table_name: "default.Table_c083bd43fffa4344b41de48e5edd3fd3" modify_external_catalogs: true
I20260808 20:00:08.793627 22908 tablet_service.cc:1511] Processing CreateTablet for tablet 89b4db48709e458293a76bcfa592ae24 (DEFAULT_TABLE table=default.table_06f9bc92453b456293c74faba2798d3b [id=53f52501c5e44774a011ce5d23f07528]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:08.798626 22908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b4db48709e458293a76bcfa592ae24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:08.811316 22678 tablet_service.cc:1511] Processing CreateTablet for tablet 89b4db48709e458293a76bcfa592ae24 (DEFAULT_TABLE table=default.table_06f9bc92453b456293c74faba2798d3b [id=53f52501c5e44774a011ce5d23f07528]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:08.813206 22678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b4db48709e458293a76bcfa592ae24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:08.819628 23384 tablet_bootstrap.cc:492] T 89b4db48709e458293a76bcfa592ae24 P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:08.824290 23384 tablet_bootstrap.cc:654] T 89b4db48709e458293a76bcfa592ae24 P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:08.825843 23384 log.cc:826] T 89b4db48709e458293a76bcfa592ae24 P e34d5caee97d44fa945a91ddc6a54653: Log is configured to *not* fsync() on all Append() calls
I20260808 20:00:08.829886 23384 tablet_bootstrap.cc:492] T 89b4db48709e458293a76bcfa592ae24 P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:08.830219 23384 ts_tablet_manager.cc:1403] T 89b4db48709e458293a76bcfa592ae24 P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.005s
I20260808 20:00:08.830472 22283 catalog_manager.cc:2200] created HMS catalog entry for table [id=87fca666b411494c8486baf1bfa58327]
I20260808 20:00:08.838508 23384 raft_consensus.cc:359] T 89b4db48709e458293a76bcfa592ae24 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:08.839113 23384 raft_consensus.cc:385] T 89b4db48709e458293a76bcfa592ae24 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:08.839217 23384 raft_consensus.cc:740] T 89b4db48709e458293a76bcfa592ae24 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:08.840235 23384 consensus_queue.cc:260] T 89b4db48709e458293a76bcfa592ae24 P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:08.843961 22283 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38088:
table { table_name: "default.Table_16d9fc25b3274923be16373085586742" } new_table_name: "default.Table_1cd24efa52a547cc872dd7ffe4938fb8" modify_external_catalogs: true
I20260808 20:00:08.843981 23146 tablet_service.cc:1511] Processing CreateTablet for tablet 89b4db48709e458293a76bcfa592ae24 (DEFAULT_TABLE table=default.table_06f9bc92453b456293c74faba2798d3b [id=53f52501c5e44774a011ce5d23f07528]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:08.845659 23386 tablet_bootstrap.cc:492] T 89b4db48709e458293a76bcfa592ae24 P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:08.845932 23146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b4db48709e458293a76bcfa592ae24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:08.849829 23386 tablet_bootstrap.cc:654] T 89b4db48709e458293a76bcfa592ae24 P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:08.851523 23386 log.cc:826] T 89b4db48709e458293a76bcfa592ae24 P 257c9c7e0c6c441593eac06beb31fa4e: Log is configured to *not* fsync() on all Append() calls
I20260808 20:00:08.857071 22908 tablet_service.cc:1511] Processing CreateTablet for tablet 7117a3852b424a2d83a00b4ebab727cf (DEFAULT_TABLE table=default.table_16d9fc25b3274923be16373085586742 [id=87fca666b411494c8486baf1bfa58327]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:08.857586 22908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7117a3852b424a2d83a00b4ebab727cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:08.857506 22678 tablet_service.cc:1511] Processing CreateTablet for tablet 7117a3852b424a2d83a00b4ebab727cf (DEFAULT_TABLE table=default.table_16d9fc25b3274923be16373085586742 [id=87fca666b411494c8486baf1bfa58327]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:08.857738 23144 tablet_service.cc:1511] Processing CreateTablet for tablet 7117a3852b424a2d83a00b4ebab727cf (DEFAULT_TABLE table=default.table_16d9fc25b3274923be16373085586742 [id=87fca666b411494c8486baf1bfa58327]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:08.857940 22678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7117a3852b424a2d83a00b4ebab727cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:08.858238 23144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7117a3852b424a2d83a00b4ebab727cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:08.858966 23384 ts_tablet_manager.cc:1434] T 89b4db48709e458293a76bcfa592ae24 P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.029s user 0.016s sys 0.003s
I20260808 20:00:08.864171 23384 tablet_bootstrap.cc:492] T 7117a3852b424a2d83a00b4ebab727cf P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:08.865985 23384 tablet_bootstrap.cc:654] T 7117a3852b424a2d83a00b4ebab727cf P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
W20260808 20:00:08.868175 23021 tablet.cc:2406] T 89b4db48709e458293a76bcfa592ae24 P e34d5caee97d44fa945a91ddc6a54653: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 20:00:08.873291 23386 tablet_bootstrap.cc:492] T 89b4db48709e458293a76bcfa592ae24 P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:08.873663 23386 ts_tablet_manager.cc:1403] T 89b4db48709e458293a76bcfa592ae24 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.028s user 0.006s sys 0.006s
I20260808 20:00:08.880847 23392 tablet_bootstrap.cc:492] T 7117a3852b424a2d83a00b4ebab727cf P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:08.885426 23392 tablet_bootstrap.cc:654] T 7117a3852b424a2d83a00b4ebab727cf P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:08.887171 23392 log.cc:826] T 7117a3852b424a2d83a00b4ebab727cf P 5f6b6c2e318d44a984120a06a09e9af9: Log is configured to *not* fsync() on all Append() calls
I20260808 20:00:08.889789 23386 raft_consensus.cc:359] T 89b4db48709e458293a76bcfa592ae24 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:08.890316 23386 raft_consensus.cc:385] T 89b4db48709e458293a76bcfa592ae24 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:08.890461 23386 raft_consensus.cc:740] T 89b4db48709e458293a76bcfa592ae24 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:08.891335 23386 consensus_queue.cc:260] T 89b4db48709e458293a76bcfa592ae24 P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:08.892491 23384 tablet_bootstrap.cc:492] T 7117a3852b424a2d83a00b4ebab727cf P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:08.892758 23384 ts_tablet_manager.cc:1403] T 7117a3852b424a2d83a00b4ebab727cf P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.029s user 0.012s sys 0.010s
I20260808 20:00:08.893426 23392 tablet_bootstrap.cc:492] T 7117a3852b424a2d83a00b4ebab727cf P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:08.893826 23392 ts_tablet_manager.cc:1403] T 7117a3852b424a2d83a00b4ebab727cf P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.013s user 0.012s sys 0.000s
I20260808 20:00:08.893966 23384 raft_consensus.cc:359] T 7117a3852b424a2d83a00b4ebab727cf P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:08.894176 23384 raft_consensus.cc:385] T 7117a3852b424a2d83a00b4ebab727cf P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:08.894285 23384 raft_consensus.cc:740] T 7117a3852b424a2d83a00b4ebab727cf P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:08.894569 23384 consensus_queue.cc:260] T 7117a3852b424a2d83a00b4ebab727cf P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:08.895200 23384 ts_tablet_manager.cc:1434] T 7117a3852b424a2d83a00b4ebab727cf P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260808 20:00:08.900105 23386 ts_tablet_manager.cc:1434] T 89b4db48709e458293a76bcfa592ae24 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.026s user 0.012s sys 0.007s
I20260808 20:00:08.903895 23386 tablet_bootstrap.cc:492] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:08.905802 23386 tablet_bootstrap.cc:654] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:08.909629 22284 catalog_manager.cc:2200] created HMS catalog entry for table [id=6ab57419bd7a4e3e97816482d3eab619]
I20260808 20:00:08.910481 23386 tablet_bootstrap.cc:492] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:08.913004 23386 ts_tablet_manager.cc:1403] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.004s
I20260808 20:00:08.912559 23392 raft_consensus.cc:359] T 7117a3852b424a2d83a00b4ebab727cf P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:08.913558 23392 raft_consensus.cc:385] T 7117a3852b424a2d83a00b4ebab727cf P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:08.913751 23392 raft_consensus.cc:740] T 7117a3852b424a2d83a00b4ebab727cf P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:08.914134 23386 raft_consensus.cc:359] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:08.914351 23386 raft_consensus.cc:385] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:08.914460 23386 raft_consensus.cc:740] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:08.914706 23386 consensus_queue.cc:260] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:08.915002 23392 consensus_queue.cc:260] T 7117a3852b424a2d83a00b4ebab727cf P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:08.915283 23386 ts_tablet_manager.cc:1434] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260808 20:00:08.926364 23392 ts_tablet_manager.cc:1434] T 7117a3852b424a2d83a00b4ebab727cf P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.032s user 0.003s sys 0.012s
I20260808 20:00:08.927075 23392 tablet_bootstrap.cc:492] T 89b4db48709e458293a76bcfa592ae24 P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:08.929113 23392 tablet_bootstrap.cc:654] T 89b4db48709e458293a76bcfa592ae24 P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:08.931738 23392 tablet_bootstrap.cc:492] T 89b4db48709e458293a76bcfa592ae24 P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:08.931947 23392 ts_tablet_manager.cc:1403] T 89b4db48709e458293a76bcfa592ae24 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.001s
I20260808 20:00:08.932956 23392 raft_consensus.cc:359] T 89b4db48709e458293a76bcfa592ae24 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:08.933198 23392 raft_consensus.cc:385] T 89b4db48709e458293a76bcfa592ae24 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:08.933341 23392 raft_consensus.cc:740] T 89b4db48709e458293a76bcfa592ae24 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:08.933597 23392 consensus_queue.cc:260] T 89b4db48709e458293a76bcfa592ae24 P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:08.934269 23392 ts_tablet_manager.cc:1434] T 89b4db48709e458293a76bcfa592ae24 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 20:00:08.935676 22908 tablet_service.cc:1511] Processing CreateTablet for tablet 2a7b98025dbf45a0881271da78fe29c0 (DEFAULT_TABLE table=default.table_b5f73af0927644749fde95d4e9e1bc95 [id=6ab57419bd7a4e3e97816482d3eab619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:08.935945 22678 tablet_service.cc:1511] Processing CreateTablet for tablet 2a7b98025dbf45a0881271da78fe29c0 (DEFAULT_TABLE table=default.table_b5f73af0927644749fde95d4e9e1bc95 [id=6ab57419bd7a4e3e97816482d3eab619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:08.936206 22908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a7b98025dbf45a0881271da78fe29c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:08.936398 22678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a7b98025dbf45a0881271da78fe29c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:08.936643 22284 master_service.cc:960] ReplaceTablet: received request to replace tablet 89b4db48709e458293a76bcfa592ae24 from {username='slave'} at 127.0.0.1:38088
I20260808 20:00:08.943722 23386 tablet_bootstrap.cc:492] T 2a7b98025dbf45a0881271da78fe29c0 P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:08.945647 23386 tablet_bootstrap.cc:654] T 2a7b98025dbf45a0881271da78fe29c0 P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:08.946656 23146 tablet_service.cc:1511] Processing CreateTablet for tablet 2a7b98025dbf45a0881271da78fe29c0 (DEFAULT_TABLE table=default.table_b5f73af0927644749fde95d4e9e1bc95 [id=6ab57419bd7a4e3e97816482d3eab619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:08.947114 23146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a7b98025dbf45a0881271da78fe29c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:08.953804 23386 tablet_bootstrap.cc:492] T 2a7b98025dbf45a0881271da78fe29c0 P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:08.954026 23386 ts_tablet_manager.cc:1403] T 2a7b98025dbf45a0881271da78fe29c0 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20260808 20:00:08.954890 23386 raft_consensus.cc:359] T 2a7b98025dbf45a0881271da78fe29c0 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:08.955130 23386 raft_consensus.cc:385] T 2a7b98025dbf45a0881271da78fe29c0 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:08.955227 23386 raft_consensus.cc:740] T 2a7b98025dbf45a0881271da78fe29c0 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:08.957927 22284 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6: Sending DeleteTablet for 3 replicas of tablet 89b4db48709e458293a76bcfa592ae24
I20260808 20:00:08.958798 22284 catalog_manager.cc:6807] ReplaceTablet: tablet 89b4db48709e458293a76bcfa592ae24 deleted and replaced by tablet ab9fb2ba3d5c490a992e704eb4582c82
I20260808 20:00:08.959604 23386 consensus_queue.cc:260] T 2a7b98025dbf45a0881271da78fe29c0 P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:08.959939 23384 tablet_bootstrap.cc:492] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:08.961335 22284 master_service.cc:960] ReplaceTablet: received request to replace tablet 89b4db48709e458293a76bcfa592ae24 from {username='slave'} at 127.0.0.1:38088
I20260808 20:00:08.961809 22284 master_service.cc:960] ReplaceTablet: received request to replace tablet 89b4db48709e458293a76bcfa592ae24 from {username='slave'} at 127.0.0.1:38088
I20260808 20:00:08.961862 23384 tablet_bootstrap.cc:654] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:08.962225 22284 master_service.cc:960] ReplaceTablet: received request to replace tablet 89b4db48709e458293a76bcfa592ae24 from {username='slave'} at 127.0.0.1:38088
I20260808 20:00:08.962612 22284 master_service.cc:960] ReplaceTablet: received request to replace tablet 89b4db48709e458293a76bcfa592ae24 from {username='slave'} at 127.0.0.1:38088
I20260808 20:00:08.963164 22284 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38088:
table { table_name: "default.Table_b5f73af0927644749fde95d4e9e1bc95" } new_table_name: "default.Table_46d148afc6d142a0855d47f765b25297" modify_external_catalogs: true
I20260808 20:00:08.963678 23386 ts_tablet_manager.cc:1434] T 2a7b98025dbf45a0881271da78fe29c0 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260808 20:00:08.966938 23392 tablet_bootstrap.cc:492] T 2a7b98025dbf45a0881271da78fe29c0 P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:08.968569 22678 tablet_service.cc:1558] Processing DeleteTablet for tablet 89b4db48709e458293a76bcfa592ae24 with delete_type TABLET_DATA_DELETED (replaced by tablet ab9fb2ba3d5c490a992e704eb4582c82) from {username='slave'} at 127.0.0.1:43572
I20260808 20:00:08.969044 22908 tablet_service.cc:1558] Processing DeleteTablet for tablet 89b4db48709e458293a76bcfa592ae24 with delete_type TABLET_DATA_DELETED (replaced by tablet ab9fb2ba3d5c490a992e704eb4582c82) from {username='slave'} at 127.0.0.1:58148
I20260808 20:00:08.972016 22285 catalog_manager.cc:2200] created HMS catalog entry for table [id=43498092c52a457d93f97ba0993e6012]
I20260808 20:00:08.975814 23146 tablet_service.cc:1558] Processing DeleteTablet for tablet 89b4db48709e458293a76bcfa592ae24 with delete_type TABLET_DATA_DELETED (replaced by tablet ab9fb2ba3d5c490a992e704eb4582c82) from {username='slave'} at 127.0.0.1:60086
I20260808 20:00:08.978008 23392 tablet_bootstrap.cc:654] T 2a7b98025dbf45a0881271da78fe29c0 P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:08.981233 23409 tablet_replica.cc:333] T 89b4db48709e458293a76bcfa592ae24 P 5f6b6c2e318d44a984120a06a09e9af9: stopping tablet replica
I20260808 20:00:08.981997 23409 raft_consensus.cc:2243] T 89b4db48709e458293a76bcfa592ae24 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:08.982791 23407 tablet_replica.cc:333] T 89b4db48709e458293a76bcfa592ae24 P 257c9c7e0c6c441593eac06beb31fa4e: stopping tablet replica
I20260808 20:00:08.983374 23409 raft_consensus.cc:2272] T 89b4db48709e458293a76bcfa592ae24 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:08.984149 23407 raft_consensus.cc:2243] T 89b4db48709e458293a76bcfa592ae24 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:08.985121 23407 raft_consensus.cc:2272] T 89b4db48709e458293a76bcfa592ae24 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:08.986366 22906 tablet_service.cc:1511] Processing CreateTablet for tablet ab9fb2ba3d5c490a992e704eb4582c82 (DEFAULT_TABLE table=default.table_06f9bc92453b456293c74faba2798d3b [id=53f52501c5e44774a011ce5d23f07528]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:08.987040 22906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab9fb2ba3d5c490a992e704eb4582c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:08.995191 23146 tablet_service.cc:1511] Processing CreateTablet for tablet ab9fb2ba3d5c490a992e704eb4582c82 (DEFAULT_TABLE table=default.table_06f9bc92453b456293c74faba2798d3b [id=53f52501c5e44774a011ce5d23f07528]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:08.996472 23146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab9fb2ba3d5c490a992e704eb4582c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:09.014637 23408 tablet_replica.cc:333] T 89b4db48709e458293a76bcfa592ae24 P e34d5caee97d44fa945a91ddc6a54653: stopping tablet replica
I20260808 20:00:09.015266 23408 raft_consensus.cc:2243] T 89b4db48709e458293a76bcfa592ae24 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:09.015813 23408 raft_consensus.cc:2272] T 89b4db48709e458293a76bcfa592ae24 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:08.986995 22676 tablet_service.cc:1511] Processing CreateTablet for tablet ab9fb2ba3d5c490a992e704eb4582c82 (DEFAULT_TABLE table=default.table_06f9bc92453b456293c74faba2798d3b [id=53f52501c5e44774a011ce5d23f07528]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:09.017470 22676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab9fb2ba3d5c490a992e704eb4582c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:09.019622 22277 catalog_manager.cc:2200] created HMS catalog entry for table [id=99b11a3c5ca3411b8c1800c70f61597a]
I20260808 20:00:09.024451 23386 tablet_bootstrap.cc:492] T ab9fb2ba3d5c490a992e704eb4582c82 P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
W20260808 20:00:09.025549 23394 raft_consensus.cc:670] T 89b4db48709e458293a76bcfa592ae24 P 257c9c7e0c6c441593eac06beb31fa4e: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopped
I20260808 20:00:09.026587 23386 tablet_bootstrap.cc:654] T ab9fb2ba3d5c490a992e704eb4582c82 P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:09.027482 23384 tablet_bootstrap.cc:492] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:09.027717 23384 ts_tablet_manager.cc:1403] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.068s user 0.006s sys 0.010s
I20260808 20:00:09.028620 23384 raft_consensus.cc:359] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.028858 23384 raft_consensus.cc:385] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:09.028934 23384 raft_consensus.cc:740] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:09.029210 23384 consensus_queue.cc:260] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.029765 23384 ts_tablet_manager.cc:1434] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 20:00:09.033264 23384 tablet_bootstrap.cc:492] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:09.035053 23384 tablet_bootstrap.cc:654] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:09.040285 23384 tablet_bootstrap.cc:492] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:09.040560 23384 ts_tablet_manager.cc:1403] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 20:00:09.041051 23407 ts_tablet_manager.cc:1916] T 89b4db48709e458293a76bcfa592ae24 P 257c9c7e0c6c441593eac06beb31fa4e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:09.041585 23384 raft_consensus.cc:359] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.041976 23384 raft_consensus.cc:385] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:09.043201 23384 raft_consensus.cc:740] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:09.043641 23384 consensus_queue.cc:260] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.044294 23384 ts_tablet_manager.cc:1434] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260808 20:00:09.043900 23409 ts_tablet_manager.cc:1916] T 89b4db48709e458293a76bcfa592ae24 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:09.047991 23386 tablet_bootstrap.cc:492] T ab9fb2ba3d5c490a992e704eb4582c82 P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:09.048193 23386 ts_tablet_manager.cc:1403] T ab9fb2ba3d5c490a992e704eb4582c82 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.024s user 0.008s sys 0.005s
I20260808 20:00:09.049160 23386 raft_consensus.cc:359] T ab9fb2ba3d5c490a992e704eb4582c82 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.049381 23386 raft_consensus.cc:385] T ab9fb2ba3d5c490a992e704eb4582c82 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:09.049475 23386 raft_consensus.cc:740] T ab9fb2ba3d5c490a992e704eb4582c82 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:09.049808 23386 consensus_queue.cc:260] T ab9fb2ba3d5c490a992e704eb4582c82 P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.050429 23386 ts_tablet_manager.cc:1434] T ab9fb2ba3d5c490a992e704eb4582c82 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 20:00:09.052927 23408 ts_tablet_manager.cc:1916] T 89b4db48709e458293a76bcfa592ae24 P e34d5caee97d44fa945a91ddc6a54653: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:09.072968 23146 tablet_service.cc:1511] Processing CreateTablet for tablet da812f335dcb4de9953235f8a9bb4fc4 (DEFAULT_TABLE table=default.table_6ac9f69790254374990cc94411d04422 [id=43498092c52a457d93f97ba0993e6012]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:09.073501 23146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da812f335dcb4de9953235f8a9bb4fc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:09.073953 22277 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38088:
name: "default.Table_3ffa098d41af4ebb987cec463feb8e76"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:09.075043 22285 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38088:
table { table_name: "default.Table_6ac9f69790254374990cc94411d04422" } new_table_name: "default.Table_4ed5029dcfbd499db24fb72e6b389d42" modify_external_catalogs: true
I20260808 20:00:09.080423 23387 raft_consensus.cc:493] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:09.080714 23387 raft_consensus.cc:515] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.083077 23387 leader_election.cc:290] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923)
W20260808 20:00:09.083590 22797 tablet.cc:2406] T 2a7b98025dbf45a0881271da78fe29c0 P 257c9c7e0c6c441593eac06beb31fa4e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 20:00:09.085762 22908 tablet_service.cc:1511] Processing CreateTablet for tablet da812f335dcb4de9953235f8a9bb4fc4 (DEFAULT_TABLE table=default.table_6ac9f69790254374990cc94411d04422 [id=43498092c52a457d93f97ba0993e6012]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:09.086288 22908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da812f335dcb4de9953235f8a9bb4fc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:09.088529 22676 tablet_service.cc:1511] Processing CreateTablet for tablet da812f335dcb4de9953235f8a9bb4fc4 (DEFAULT_TABLE table=default.table_6ac9f69790254374990cc94411d04422 [id=43498092c52a457d93f97ba0993e6012]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:09.088986 22676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da812f335dcb4de9953235f8a9bb4fc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:09.092936 23384 tablet_bootstrap.cc:492] T da812f335dcb4de9953235f8a9bb4fc4 P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:09.094884 23384 tablet_bootstrap.cc:654] T da812f335dcb4de9953235f8a9bb4fc4 P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:09.101377 23407 ts_tablet_manager.cc:1929] T 89b4db48709e458293a76bcfa592ae24 P 257c9c7e0c6c441593eac06beb31fa4e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260808 20:00:09.103621 23409 ts_tablet_manager.cc:1929] T 89b4db48709e458293a76bcfa592ae24 P 5f6b6c2e318d44a984120a06a09e9af9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260808 20:00:09.107363 23408 ts_tablet_manager.cc:1929] T 89b4db48709e458293a76bcfa592ae24 P e34d5caee97d44fa945a91ddc6a54653: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260808 20:00:09.112962 23409 log.cc:1199] T 89b4db48709e458293a76bcfa592ae24 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/wal/wals/89b4db48709e458293a76bcfa592ae24
I20260808 20:00:09.113233 23179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a7b98025dbf45a0881271da78fe29c0" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9" is_pre_election: true
I20260808 20:00:09.113612 23409 ts_tablet_manager.cc:1950] T 89b4db48709e458293a76bcfa592ae24 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting consensus metadata
I20260808 20:00:09.109745 22678 tablet_service.cc:1511] Processing CreateTablet for tablet 78ab65d40a004ef9888b6577716b783c (DEFAULT_TABLE table=default.table_b91802b5296a416490e52b3cb07d0519 [id=99b11a3c5ca3411b8c1800c70f61597a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:09.115002 22678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78ab65d40a004ef9888b6577716b783c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:09.109373 23146 tablet_service.cc:1511] Processing CreateTablet for tablet 78ab65d40a004ef9888b6577716b783c (DEFAULT_TABLE table=default.table_b91802b5296a416490e52b3cb07d0519 [id=99b11a3c5ca3411b8c1800c70f61597a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:09.115666 23146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78ab65d40a004ef9888b6577716b783c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:09.100224 22711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a7b98025dbf45a0881271da78fe29c0" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e" is_pre_election: true
I20260808 20:00:09.114461 23394 raft_consensus.cc:493] T 2a7b98025dbf45a0881271da78fe29c0 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:09.117308 23394 raft_consensus.cc:515] T 2a7b98025dbf45a0881271da78fe29c0 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.119716 23394 leader_election.cc:290] T 2a7b98025dbf45a0881271da78fe29c0 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:09.124876 23386 tablet_bootstrap.cc:492] T da812f335dcb4de9953235f8a9bb4fc4 P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:09.125138 22711 raft_consensus.cc:2468] T 2a7b98025dbf45a0881271da78fe29c0 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 0.
I20260808 20:00:09.126857 23386 tablet_bootstrap.cc:654] T da812f335dcb4de9953235f8a9bb4fc4 P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:09.131909 23179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a7b98025dbf45a0881271da78fe29c0" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9" is_pre_election: true
I20260808 20:00:09.132292 23392 tablet_bootstrap.cc:492] T 2a7b98025dbf45a0881271da78fe29c0 P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:09.132486 23392 ts_tablet_manager.cc:1403] T 2a7b98025dbf45a0881271da78fe29c0 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.166s user 0.023s sys 0.019s
W20260808 20:00:09.133034 22607 leader_election.cc:343] T 2a7b98025dbf45a0881271da78fe29c0 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Illegal state: must be running to vote when last-logged opid is not known
I20260808 20:00:09.133227 23392 raft_consensus.cc:359] T 2a7b98025dbf45a0881271da78fe29c0 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.133437 23392 raft_consensus.cc:385] T 2a7b98025dbf45a0881271da78fe29c0 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:09.133518 23392 raft_consensus.cc:740] T 2a7b98025dbf45a0881271da78fe29c0 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:09.137389 23392 consensus_queue.cc:260] T 2a7b98025dbf45a0881271da78fe29c0 P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.140429 23392 ts_tablet_manager.cc:1434] T 2a7b98025dbf45a0881271da78fe29c0 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260808 20:00:09.144214 23392 tablet_bootstrap.cc:492] T ab9fb2ba3d5c490a992e704eb4582c82 P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:09.145069 23407 log.cc:1199] T 89b4db48709e458293a76bcfa592ae24 P 257c9c7e0c6c441593eac06beb31fa4e: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-0/wal/wals/89b4db48709e458293a76bcfa592ae24
I20260808 20:00:09.146114 23392 tablet_bootstrap.cc:654] T ab9fb2ba3d5c490a992e704eb4582c82 P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:09.147351 22268 catalog_manager.cc:5050] TS 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): tablet 89b4db48709e458293a76bcfa592ae24 (table default.table_06f9bc92453b456293c74faba2798d3b [id=53f52501c5e44774a011ce5d23f07528]) successfully deleted
I20260808 20:00:09.147781 23407 ts_tablet_manager.cc:1950] T 89b4db48709e458293a76bcfa592ae24 P 257c9c7e0c6c441593eac06beb31fa4e: Deleting consensus metadata
W20260808 20:00:09.148074 23258 tablet.cc:2406] T 2a7b98025dbf45a0881271da78fe29c0 P 5f6b6c2e318d44a984120a06a09e9af9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 20:00:09.148977 23386 tablet_bootstrap.cc:492] T da812f335dcb4de9953235f8a9bb4fc4 P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:09.149245 23386 ts_tablet_manager.cc:1403] T da812f335dcb4de9953235f8a9bb4fc4 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.004s
I20260808 20:00:09.150244 23386 raft_consensus.cc:359] T da812f335dcb4de9953235f8a9bb4fc4 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.150574 23386 raft_consensus.cc:385] T da812f335dcb4de9953235f8a9bb4fc4 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:09.109535 22908 tablet_service.cc:1511] Processing CreateTablet for tablet 78ab65d40a004ef9888b6577716b783c (DEFAULT_TABLE table=default.table_b91802b5296a416490e52b3cb07d0519 [id=99b11a3c5ca3411b8c1800c70f61597a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:09.150704 23386 raft_consensus.cc:740] T da812f335dcb4de9953235f8a9bb4fc4 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:09.150849 23408 log.cc:1199] T 89b4db48709e458293a76bcfa592ae24 P e34d5caee97d44fa945a91ddc6a54653: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/wal/wals/89b4db48709e458293a76bcfa592ae24
I20260808 20:00:09.151129 22908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78ab65d40a004ef9888b6577716b783c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:09.151260 23386 consensus_queue.cc:260] T da812f335dcb4de9953235f8a9bb4fc4 P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.151443 23408 ts_tablet_manager.cc:1950] T 89b4db48709e458293a76bcfa592ae24 P e34d5caee97d44fa945a91ddc6a54653: Deleting consensus metadata
I20260808 20:00:09.153463 23386 ts_tablet_manager.cc:1434] T da812f335dcb4de9953235f8a9bb4fc4 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260808 20:00:09.111774 23387 raft_consensus.cc:493] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260808 20:00:09.115008 22835 leader_election.cc:343] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Illegal state: must be running to vote when last-logged opid is not known
I20260808 20:00:09.153667 23387 raft_consensus.cc:515] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.153924 23386 tablet_bootstrap.cc:492] T 78ab65d40a004ef9888b6577716b783c P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:09.154412 23387 leader_election.cc:290] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:09.155354 22265 catalog_manager.cc:5050] TS 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): tablet 89b4db48709e458293a76bcfa592ae24 (table default.table_06f9bc92453b456293c74faba2798d3b [id=53f52501c5e44774a011ce5d23f07528]) successfully deleted
I20260808 20:00:09.155445 23179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9fb2ba3d5c490a992e704eb4582c82" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9" is_pre_election: true
W20260808 20:00:09.156106 22835 leader_election.cc:343] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Illegal state: must be running to vote when last-logged opid is not known
I20260808 20:00:09.157123 23386 tablet_bootstrap.cc:654] T 78ab65d40a004ef9888b6577716b783c P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:09.158064 22265 catalog_manager.cc:5050] TS e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): tablet 89b4db48709e458293a76bcfa592ae24 (table default.table_06f9bc92453b456293c74faba2798d3b [id=53f52501c5e44774a011ce5d23f07528]) successfully deleted
I20260808 20:00:09.159358 22831 leader_election.cc:304] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, e34d5caee97d44fa945a91ddc6a54653; no voters: 5f6b6c2e318d44a984120a06a09e9af9
I20260808 20:00:09.159907 23387 raft_consensus.cc:2804] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:09.160034 23387 raft_consensus.cc:493] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:09.160145 23387 raft_consensus.cc:3060] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:09.161098 22711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9fb2ba3d5c490a992e704eb4582c82" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e" is_pre_election: true
I20260808 20:00:09.161337 22711 raft_consensus.cc:2468] T ab9fb2ba3d5c490a992e704eb4582c82 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 0.
I20260808 20:00:09.161896 22831 leader_election.cc:304] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, e34d5caee97d44fa945a91ddc6a54653; no voters: 5f6b6c2e318d44a984120a06a09e9af9
I20260808 20:00:09.163368 23387 raft_consensus.cc:515] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.164942 23179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a7b98025dbf45a0881271da78fe29c0" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9"
I20260808 20:00:09.165249 23179 raft_consensus.cc:3060] T 2a7b98025dbf45a0881271da78fe29c0 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:09.165910 23392 tablet_bootstrap.cc:492] T ab9fb2ba3d5c490a992e704eb4582c82 P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:09.166080 23392 ts_tablet_manager.cc:1403] T ab9fb2ba3d5c490a992e704eb4582c82 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.002s
I20260808 20:00:09.167788 22287 catalog_manager.cc:2200] created HMS catalog entry for table [id=373408577a474e4bb9f6ad9aec399098]
I20260808 20:00:09.168853 23179 raft_consensus.cc:2468] T 2a7b98025dbf45a0881271da78fe29c0 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 1.
I20260808 20:00:09.169492 22835 leader_election.cc:304] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:09.173702 23387 leader_election.cc:290] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 election: Requested vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923)
I20260808 20:00:09.173974 23387 raft_consensus.cc:2804] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:09.174089 23387 raft_consensus.cc:493] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:09.174177 23387 raft_consensus.cc:3060] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:09.177031 23387 raft_consensus.cc:515] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.184370 23387 leader_election.cc:290] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 election: Requested vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:09.184676 23387 raft_consensus.cc:2804] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:09.184855 23387 raft_consensus.cc:697] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653 [term 1 LEADER]: Becoming Leader. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Running, Role: LEADER
I20260808 20:00:09.185376 23387 consensus_queue.cc:237] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.196714 22908 tablet_service.cc:1511] Processing CreateTablet for tablet 4e7bbbf891cd4500a8ec7f3d21905240 (DEFAULT_TABLE table=default.table_f4c950a229114bde8c62335c66af32ed [id=373408577a474e4bb9f6ad9aec399098]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:09.196707 22678 tablet_service.cc:1511] Processing CreateTablet for tablet 4e7bbbf891cd4500a8ec7f3d21905240 (DEFAULT_TABLE table=default.table_f4c950a229114bde8c62335c66af32ed [id=373408577a474e4bb9f6ad9aec399098]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:09.197265 22908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e7bbbf891cd4500a8ec7f3d21905240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:09.197178 23146 tablet_service.cc:1511] Processing CreateTablet for tablet 4e7bbbf891cd4500a8ec7f3d21905240 (DEFAULT_TABLE table=default.table_f4c950a229114bde8c62335c66af32ed [id=373408577a474e4bb9f6ad9aec399098]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:09.197273 22678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e7bbbf891cd4500a8ec7f3d21905240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:09.197619 23146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e7bbbf891cd4500a8ec7f3d21905240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:09.201520 22287 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38088:
name: "default.Table_530ab728450b4272b3e9573534afe4e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:09.167210 23392 raft_consensus.cc:359] T ab9fb2ba3d5c490a992e704eb4582c82 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.202621 23392 raft_consensus.cc:385] T ab9fb2ba3d5c490a992e704eb4582c82 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:09.202993 23384 tablet_bootstrap.cc:492] T da812f335dcb4de9953235f8a9bb4fc4 P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:09.203218 23384 ts_tablet_manager.cc:1403] T da812f335dcb4de9953235f8a9bb4fc4 P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.110s user 0.014s sys 0.002s
I20260808 20:00:09.203203 23392 raft_consensus.cc:740] T ab9fb2ba3d5c490a992e704eb4582c82 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:09.204128 23392 consensus_queue.cc:260] T ab9fb2ba3d5c490a992e704eb4582c82 P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.204218 23384 raft_consensus.cc:359] T da812f335dcb4de9953235f8a9bb4fc4 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.204461 23384 raft_consensus.cc:385] T da812f335dcb4de9953235f8a9bb4fc4 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:09.204560 23384 raft_consensus.cc:740] T da812f335dcb4de9953235f8a9bb4fc4 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:09.204821 23384 consensus_queue.cc:260] T da812f335dcb4de9953235f8a9bb4fc4 P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.206641 23179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9fb2ba3d5c490a992e704eb4582c82" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9"
I20260808 20:00:09.206935 23179 raft_consensus.cc:3060] T ab9fb2ba3d5c490a992e704eb4582c82 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:09.207396 23392 ts_tablet_manager.cc:1434] T ab9fb2ba3d5c490a992e704eb4582c82 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.041s user 0.002s sys 0.001s
I20260808 20:00:09.208220 23384 ts_tablet_manager.cc:1434] T da812f335dcb4de9953235f8a9bb4fc4 P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260808 20:00:09.208595 23384 tablet_bootstrap.cc:492] T 78ab65d40a004ef9888b6577716b783c P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:09.209177 23386 tablet_bootstrap.cc:492] T 78ab65d40a004ef9888b6577716b783c P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:09.209439 23386 ts_tablet_manager.cc:1403] T 78ab65d40a004ef9888b6577716b783c P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.056s user 0.004s sys 0.000s
I20260808 20:00:09.210477 23386 raft_consensus.cc:359] T 78ab65d40a004ef9888b6577716b783c P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:09.210914 23386 raft_consensus.cc:385] T 78ab65d40a004ef9888b6577716b783c P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:09.211021 23386 raft_consensus.cc:740] T 78ab65d40a004ef9888b6577716b783c P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:09.211339 23386 consensus_queue.cc:260] T 78ab65d40a004ef9888b6577716b783c P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:09.211750 23384 tablet_bootstrap.cc:654] T 78ab65d40a004ef9888b6577716b783c P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:09.210817 23179 raft_consensus.cc:2468] T ab9fb2ba3d5c490a992e704eb4582c82 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 1.
I20260808 20:00:09.213630 23392 tablet_bootstrap.cc:492] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:09.215521 23392 tablet_bootstrap.cc:654] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:09.217936 22941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a7b98025dbf45a0881271da78fe29c0" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653" is_pre_election: true
I20260808 20:00:09.220749 23386 ts_tablet_manager.cc:1434] T 78ab65d40a004ef9888b6577716b783c P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260808 20:00:09.219273 22835 leader_election.cc:304] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:09.224387 23386 tablet_bootstrap.cc:492] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:09.225023 22604 leader_election.cc:304] T 2a7b98025dbf45a0881271da78fe29c0 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:00:09.226064 23394 raft_consensus.cc:2749] T 2a7b98025dbf45a0881271da78fe29c0 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 20:00:09.226387 23386 tablet_bootstrap.cc:654] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:09.227744 23441 raft_consensus.cc:2804] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:09.227946 23441 raft_consensus.cc:697] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653 [term 1 LEADER]: Becoming Leader. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Running, Role: LEADER
W20260808 20:00:09.228430 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.36.65:39923, user_credentials={real_user=slave}} blocked reactor thread for 66545.1us
I20260808 20:00:09.228385 23441 consensus_queue.cc:237] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.229342 22711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a7b98025dbf45a0881271da78fe29c0" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e"
I20260808 20:00:09.229591 22711 raft_consensus.cc:3060] T 2a7b98025dbf45a0881271da78fe29c0 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:09.231055 23392 tablet_bootstrap.cc:492] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:09.231259 23392 ts_tablet_manager.cc:1403] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.004s
I20260808 20:00:09.232131 23392 raft_consensus.cc:359] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.232388 23392 raft_consensus.cc:385] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:09.232477 23392 raft_consensus.cc:740] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:09.232800 23392 consensus_queue.cc:260] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.232900 22711 raft_consensus.cc:2468] T 2a7b98025dbf45a0881271da78fe29c0 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 1.
I20260808 20:00:09.233875 22711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9fb2ba3d5c490a992e704eb4582c82" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e"
I20260808 20:00:09.234102 22711 raft_consensus.cc:3060] T ab9fb2ba3d5c490a992e704eb4582c82 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:09.237129 23392 ts_tablet_manager.cc:1434] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260808 20:00:09.237327 22711 raft_consensus.cc:2468] T ab9fb2ba3d5c490a992e704eb4582c82 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 1.
I20260808 20:00:09.240000 23384 tablet_bootstrap.cc:492] T 78ab65d40a004ef9888b6577716b783c P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:09.240188 23384 ts_tablet_manager.cc:1403] T 78ab65d40a004ef9888b6577716b783c P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.003s
I20260808 20:00:09.240900 23392 tablet_bootstrap.cc:492] T 78ab65d40a004ef9888b6577716b783c P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:09.241082 23384 raft_consensus.cc:359] T 78ab65d40a004ef9888b6577716b783c P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:09.241334 23384 raft_consensus.cc:385] T 78ab65d40a004ef9888b6577716b783c P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:09.241431 23384 raft_consensus.cc:740] T 78ab65d40a004ef9888b6577716b783c P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:09.241734 23384 consensus_queue.cc:260] T 78ab65d40a004ef9888b6577716b783c P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:09.242290 23384 ts_tablet_manager.cc:1434] T 78ab65d40a004ef9888b6577716b783c P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 20:00:09.242597 23384 tablet_bootstrap.cc:492] T 4e7bbbf891cd4500a8ec7f3d21905240 P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:09.242609 23392 tablet_bootstrap.cc:654] T 78ab65d40a004ef9888b6577716b783c P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:09.243713 23396 raft_consensus.cc:493] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:09.243919 23396 raft_consensus.cc:515] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.245959 23396 leader_election.cc:290] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:09.250974 23384 tablet_bootstrap.cc:654] T 4e7bbbf891cd4500a8ec7f3d21905240 P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:09.260028 22711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da812f335dcb4de9953235f8a9bb4fc4" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e" is_pre_election: true
I20260808 20:00:09.260299 22711 raft_consensus.cc:2468] T da812f335dcb4de9953235f8a9bb4fc4 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 0.
I20260808 20:00:09.261345 23386 tablet_bootstrap.cc:492] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:09.261544 23386 ts_tablet_manager.cc:1403] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.001s
I20260808 20:00:09.261577 23384 tablet_bootstrap.cc:492] T 4e7bbbf891cd4500a8ec7f3d21905240 P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:09.261780 23384 ts_tablet_manager.cc:1403] T 4e7bbbf891cd4500a8ec7f3d21905240 P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.003s
I20260808 20:00:09.262477 23386 raft_consensus.cc:359] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.262703 23386 raft_consensus.cc:385] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:09.262632 23384 raft_consensus.cc:359] T 4e7bbbf891cd4500a8ec7f3d21905240 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.262796 23386 raft_consensus.cc:740] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:09.262861 23384 raft_consensus.cc:385] T 4e7bbbf891cd4500a8ec7f3d21905240 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:09.262946 23384 raft_consensus.cc:740] T 4e7bbbf891cd4500a8ec7f3d21905240 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:09.263073 23386 consensus_queue.cc:260] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.263247 23384 consensus_queue.cc:260] T 4e7bbbf891cd4500a8ec7f3d21905240 P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.263698 23386 ts_tablet_manager.cc:1434] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 20:00:09.265661 23066 leader_election.cc:304] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, 5f6b6c2e318d44a984120a06a09e9af9; no voters:
I20260808 20:00:09.266166 23396 raft_consensus.cc:2804] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:09.266317 23396 raft_consensus.cc:493] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:09.266417 23396 raft_consensus.cc:3060] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:09.267395 23384 ts_tablet_manager.cc:1434] T 4e7bbbf891cd4500a8ec7f3d21905240 P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260808 20:00:09.269829 23396 raft_consensus.cc:515] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.270520 23396 leader_election.cc:290] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 election: Requested vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:09.271797 22711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da812f335dcb4de9953235f8a9bb4fc4" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e"
I20260808 20:00:09.272025 22711 raft_consensus.cc:3060] T da812f335dcb4de9953235f8a9bb4fc4 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:09.274950 22711 raft_consensus.cc:2468] T da812f335dcb4de9953235f8a9bb4fc4 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 1.
I20260808 20:00:09.277151 23066 leader_election.cc:304] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, 5f6b6c2e318d44a984120a06a09e9af9; no voters:
I20260808 20:00:09.277689 23396 raft_consensus.cc:2804] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:09.278060 22941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da812f335dcb4de9953235f8a9bb4fc4" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653" is_pre_election: true
I20260808 20:00:09.278409 22941 raft_consensus.cc:2468] T da812f335dcb4de9953235f8a9bb4fc4 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 0.
I20260808 20:00:09.278810 22938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da812f335dcb4de9953235f8a9bb4fc4" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653"
I20260808 20:00:09.279052 22938 raft_consensus.cc:3060] T da812f335dcb4de9953235f8a9bb4fc4 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:09.281759 23392 tablet_bootstrap.cc:492] T 78ab65d40a004ef9888b6577716b783c P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:09.281926 23392 ts_tablet_manager.cc:1403] T 78ab65d40a004ef9888b6577716b783c P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.041s user 0.000s sys 0.005s
I20260808 20:00:09.282401 22938 raft_consensus.cc:2468] T da812f335dcb4de9953235f8a9bb4fc4 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 1.
I20260808 20:00:09.282788 23392 raft_consensus.cc:359] T 78ab65d40a004ef9888b6577716b783c P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:09.283030 23392 raft_consensus.cc:385] T 78ab65d40a004ef9888b6577716b783c P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:09.283133 23392 raft_consensus.cc:740] T 78ab65d40a004ef9888b6577716b783c P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:09.283417 23392 consensus_queue.cc:260] T 78ab65d40a004ef9888b6577716b783c P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:09.285995 23396 raft_consensus.cc:697] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 LEADER]: Becoming Leader. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Running, Role: LEADER
I20260808 20:00:09.286651 23396 consensus_queue.cc:237] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.289557 23394 raft_consensus.cc:493] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:09.289793 22275 catalog_manager.cc:2200] created HMS catalog entry for table [id=3b10ed2d37fe46a5b63d646901474c8e]
I20260808 20:00:09.289790 23394 raft_consensus.cc:515] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.290565 23394 leader_election.cc:290] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:09.291256 23179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7bbbf891cd4500a8ec7f3d21905240" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9" is_pre_election: true
I20260808 20:00:09.291494 22938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7bbbf891cd4500a8ec7f3d21905240" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653" is_pre_election: true
I20260808 20:00:09.291739 22938 raft_consensus.cc:2468] T 4e7bbbf891cd4500a8ec7f3d21905240 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 0.
W20260808 20:00:09.291915 22607 leader_election.cc:343] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Illegal state: must be running to vote when last-logged opid is not known
I20260808 20:00:09.292512 22604 leader_election.cc:304] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, e34d5caee97d44fa945a91ddc6a54653; no voters: 5f6b6c2e318d44a984120a06a09e9af9
I20260808 20:00:09.293120 23394 raft_consensus.cc:2804] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:09.293239 23394 raft_consensus.cc:493] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:09.293350 23394 raft_consensus.cc:3060] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:09.296528 23394 raft_consensus.cc:515] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.297798 23179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7bbbf891cd4500a8ec7f3d21905240" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9"
I20260808 20:00:09.297973 22938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7bbbf891cd4500a8ec7f3d21905240" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653"
I20260808 20:00:09.298211 22938 raft_consensus.cc:3060] T 4e7bbbf891cd4500a8ec7f3d21905240 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
W20260808 20:00:09.298514 22607 leader_election.cc:343] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Illegal state: must be running to vote when last-logged opid is not known
I20260808 20:00:09.299950 23394 leader_election.cc:290] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 election: Requested vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:09.301162 22938 raft_consensus.cc:2468] T 4e7bbbf891cd4500a8ec7f3d21905240 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 1.
I20260808 20:00:09.301729 22604 leader_election.cc:304] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, e34d5caee97d44fa945a91ddc6a54653; no voters: 5f6b6c2e318d44a984120a06a09e9af9
I20260808 20:00:09.301981 22275 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:38088 (request call id 10) took 1076 ms. Trace:
I20260808 20:00:09.302307 23394 raft_consensus.cc:2804] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:09.302171 22275 rpcz_store.cc:276] 0808 20:00:08.225381 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:08.225456 (+ 75us) service_pool.cc:224] Handling call
0808 20:00:08.255378 (+ 29922us) catalog_manager.cc:2127] Acquired catalog manager lock
0808 20:00:08.258693 (+ 3315us) catalog_manager.cc:2173] Created new table and tablet info
0808 20:00:09.289740 (+1031047us) catalog_manager.cc:2199] Created new table in HMS catalog
0808 20:00:09.301663 (+ 11923us) catalog_manager.cc:2233] Wrote table and tablets to system table
0808 20:00:09.301792 (+ 129us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0808 20:00:09.301923 (+ 131us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0808 20:00:09.290636 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0808 20:00:09.290781 (+ 145us) write_op.cc:432] Acquiring schema lock in shared mode
0808 20:00:09.290788 (+ 7us) write_op.cc:435] Acquired schema lock
0808 20:00:09.290791 (+ 3us) tablet.cc:662] Decoding operations
0808 20:00:09.290887 (+ 96us) write_op.cc:620] Acquiring the partition lock for write op
0808 20:00:09.290900 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0808 20:00:09.290905 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0808 20:00:09.290991 (+ 86us) tablet.cc:701] Row locks acquired
0808 20:00:09.290993 (+ 2us) write_op.cc:260] PREPARE: finished
0808 20:00:09.291037 (+ 44us) write_op.cc:270] Start()
0808 20:00:09.291073 (+ 36us) write_op.cc:276] Timestamp: P: 1786219209290972 usec, L: 0
0808 20:00:09.291077 (+ 4us) op_driver.cc:348] REPLICATION: starting
0808 20:00:09.291278 (+ 201us) log.cc:844] Serialized 432 byte log entry
0808 20:00:09.300609 (+ 9331us) op_driver.cc:464] REPLICATION: finished
0808 20:00:09.300767 (+ 158us) write_op.cc:301] APPLY: starting
0808 20:00:09.300787 (+ 20us) tablet.cc:1367] starting BulkCheckPresence
0808 20:00:09.300837 (+ 50us) tablet.cc:1370] finished BulkCheckPresence
0808 20:00:09.300873 (+ 36us) tablet.cc:1372] starting ApplyRowOperation cycle
0808 20:00:09.300982 (+ 109us) tablet.cc:1383] finished ApplyRowOperation cycle
0808 20:00:09.301020 (+ 38us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0808 20:00:09.301028 (+ 8us) write_op.cc:312] APPLY: finished
0808 20:00:09.301135 (+ 107us) log.cc:844] Serialized 28 byte log entry
0808 20:00:09.301210 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0808 20:00:09.301237 (+ 27us) write_op.cc:454] Released schema lock
0808 20:00:09.301245 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0808 20:00:09.301331 (+ 86us) write_op.cc:489] Releasing partition, row and schema locks
0808 20:00:09.301335 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":908641,"Hive Metastore.run_cpu_time_us":355,"Hive Metastore.run_wall_time_us":122001,"child_traces":[["op",{"apply.queue_time_us":105,"apply.run_cpu_time_us":551,"apply.run_wall_time_us":551,"num_ops":2,"prepare.queue_time_us":70,"prepare.run_cpu_time_us":763,"prepare.run_wall_time_us":763,"raft.queue_time_us":1471,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":287,"replication_time_us":9492}]]}
I20260808 20:00:09.317374 22908 tablet_service.cc:1511] Processing CreateTablet for tablet a89c8105460e45f9a77af8c7cf84607c (DEFAULT_TABLE table=default.table_752d0310c94b42d3902fffa1070bb1d4 [id=3b10ed2d37fe46a5b63d646901474c8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:09.317363 23146 tablet_service.cc:1511] Processing CreateTablet for tablet a89c8105460e45f9a77af8c7cf84607c (DEFAULT_TABLE table=default.table_752d0310c94b42d3902fffa1070bb1d4 [id=3b10ed2d37fe46a5b63d646901474c8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:09.317546 22678 tablet_service.cc:1511] Processing CreateTablet for tablet a89c8105460e45f9a77af8c7cf84607c (DEFAULT_TABLE table=default.table_752d0310c94b42d3902fffa1070bb1d4 [id=3b10ed2d37fe46a5b63d646901474c8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:09.317865 22908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a89c8105460e45f9a77af8c7cf84607c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:09.317870 23146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a89c8105460e45f9a77af8c7cf84607c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:09.317999 22678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a89c8105460e45f9a77af8c7cf84607c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:09.315446 22275 catalog_manager.cc:5719] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653 reported cstate change: term changed from 0 to 1, leader changed from <none> to e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66). New cstate: current_term: 1 leader_uuid: "e34d5caee97d44fa945a91ddc6a54653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } health_report { overall_health: HEALTHY } } }
I20260808 20:00:09.323241 22275 catalog_manager.cc:5719] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653 reported cstate change: term changed from 0 to 1, leader changed from <none> to e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66). New cstate: current_term: 1 leader_uuid: "e34d5caee97d44fa945a91ddc6a54653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } health_report { overall_health: UNKNOWN } } }
I20260808 20:00:09.324537 23384 tablet_bootstrap.cc:492] T a89c8105460e45f9a77af8c7cf84607c P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:09.326368 23384 tablet_bootstrap.cc:654] T a89c8105460e45f9a77af8c7cf84607c P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:09.329094 23386 tablet_bootstrap.cc:492] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:09.331156 23386 tablet_bootstrap.cc:654] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:09.334380 22275 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38088:
table { table_name: "default.Table_b91802b5296a416490e52b3cb07d0519" } new_table_name: "default.Table_583f1fdac11148488799008b032f7ef2" modify_external_catalogs: true
I20260808 20:00:09.345503 23386 tablet_bootstrap.cc:492] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:09.346032 23386 ts_tablet_manager.cc:1403] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.008s
I20260808 20:00:09.347028 23386 raft_consensus.cc:359] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:09.347347 23386 raft_consensus.cc:385] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:09.347520 23386 raft_consensus.cc:740] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:09.348033 23386 consensus_queue.cc:260] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:09.350454 23384 tablet_bootstrap.cc:492] T a89c8105460e45f9a77af8c7cf84607c P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:09.350647 23384 ts_tablet_manager.cc:1403] T a89c8105460e45f9a77af8c7cf84607c P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.008s
I20260808 20:00:09.351503 23384 raft_consensus.cc:359] T a89c8105460e45f9a77af8c7cf84607c P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:09.351711 23384 raft_consensus.cc:385] T a89c8105460e45f9a77af8c7cf84607c P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:09.351806 23384 raft_consensus.cc:740] T a89c8105460e45f9a77af8c7cf84607c P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:09.352126 23384 consensus_queue.cc:260] T a89c8105460e45f9a77af8c7cf84607c P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:09.355546 23384 ts_tablet_manager.cc:1434] T a89c8105460e45f9a77af8c7cf84607c P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260808 20:00:09.359133 23392 ts_tablet_manager.cc:1434] T 78ab65d40a004ef9888b6577716b783c P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.077s user 0.003s sys 0.002s
I20260808 20:00:09.359813 23392 tablet_bootstrap.cc:492] T 4e7bbbf891cd4500a8ec7f3d21905240 P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:09.360394 23386 ts_tablet_manager.cc:1434] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.014s user 0.005s sys 0.001s
I20260808 20:00:09.361773 23392 tablet_bootstrap.cc:654] T 4e7bbbf891cd4500a8ec7f3d21905240 P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:09.372335 22282 catalog_manager.cc:2200] created HMS catalog entry for table [id=06447c1e53ac4366baae14ef41588d7f]
I20260808 20:00:09.379344 22282 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:38088 (request call id 6) took 1155 ms. Trace:
I20260808 20:00:09.379565 22282 rpcz_store.cc:276] 0808 20:00:08.223374 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:08.223502 (+ 128us) service_pool.cc:224] Handling call
0808 20:00:08.250917 (+ 27415us) catalog_manager.cc:2127] Acquired catalog manager lock
0808 20:00:08.251412 (+ 495us) catalog_manager.cc:2173] Created new table and tablet info
0808 20:00:09.372261 (+1120849us) catalog_manager.cc:2199] Created new table in HMS catalog
0808 20:00:09.379040 (+ 6779us) catalog_manager.cc:2233] Wrote table and tablets to system table
0808 20:00:09.379172 (+ 132us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0808 20:00:09.379293 (+ 121us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0808 20:00:09.373410 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0808 20:00:09.373544 (+ 134us) write_op.cc:432] Acquiring schema lock in shared mode
0808 20:00:09.373552 (+ 8us) write_op.cc:435] Acquired schema lock
0808 20:00:09.373554 (+ 2us) tablet.cc:662] Decoding operations
0808 20:00:09.373673 (+ 119us) write_op.cc:620] Acquiring the partition lock for write op
0808 20:00:09.373688 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0808 20:00:09.373694 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0808 20:00:09.373781 (+ 87us) tablet.cc:701] Row locks acquired
0808 20:00:09.373784 (+ 3us) write_op.cc:260] PREPARE: finished
0808 20:00:09.373829 (+ 45us) write_op.cc:270] Start()
0808 20:00:09.373866 (+ 37us) write_op.cc:276] Timestamp: P: 1786219209373809 usec, L: 0
0808 20:00:09.373870 (+ 4us) op_driver.cc:348] REPLICATION: starting
0808 20:00:09.374101 (+ 231us) log.cc:844] Serialized 432 byte log entry
0808 20:00:09.377973 (+ 3872us) op_driver.cc:464] REPLICATION: finished
0808 20:00:09.378146 (+ 173us) write_op.cc:301] APPLY: starting
0808 20:00:09.378164 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0808 20:00:09.378212 (+ 48us) tablet.cc:1370] finished BulkCheckPresence
0808 20:00:09.378250 (+ 38us) tablet.cc:1372] starting ApplyRowOperation cycle
0808 20:00:09.378363 (+ 113us) tablet.cc:1383] finished ApplyRowOperation cycle
0808 20:00:09.378411 (+ 48us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0808 20:00:09.378418 (+ 7us) write_op.cc:312] APPLY: finished
0808 20:00:09.378512 (+ 94us) log.cc:844] Serialized 28 byte log entry
0808 20:00:09.378590 (+ 78us) write_op.cc:489] Releasing partition, row and schema locks
0808 20:00:09.378616 (+ 26us) write_op.cc:454] Released schema lock
0808 20:00:09.378624 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0808 20:00:09.378707 (+ 83us) write_op.cc:489] Releasing partition, row and schema locks
0808 20:00:09.378711 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1030641,"Hive Metastore.run_cpu_time_us":300,"Hive Metastore.run_wall_time_us":82626,"child_traces":[["op",{"apply.queue_time_us":118,"apply.run_cpu_time_us":552,"apply.run_wall_time_us":551,"num_ops":2,"prepare.queue_time_us":179,"prepare.run_cpu_time_us":839,"prepare.run_wall_time_us":840,"raft.queue_time_us":1308,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":295,"replication_time_us":4070}]]}
W20260808 20:00:09.380414 22281 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_831d17f2742e4fb8bc727d56fc9d1c85 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 20:00:09.383141 22282 catalog_manager.cc:5719] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67). New cstate: current_term: 1 leader_uuid: "5f6b6c2e318d44a984120a06a09e9af9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } health_report { overall_health: HEALTHY } } }
I20260808 20:00:09.390270 23394 raft_consensus.cc:697] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 LEADER]: Becoming Leader. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Running, Role: LEADER
I20260808 20:00:09.390931 23394 consensus_queue.cc:237] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.392863 23392 tablet_bootstrap.cc:492] T 4e7bbbf891cd4500a8ec7f3d21905240 P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:09.393059 23392 ts_tablet_manager.cc:1403] T 4e7bbbf891cd4500a8ec7f3d21905240 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.000s
I20260808 20:00:09.393970 23392 raft_consensus.cc:359] T 4e7bbbf891cd4500a8ec7f3d21905240 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.394193 23392 raft_consensus.cc:385] T 4e7bbbf891cd4500a8ec7f3d21905240 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:09.394273 23392 raft_consensus.cc:740] T 4e7bbbf891cd4500a8ec7f3d21905240 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:09.394574 23392 consensus_queue.cc:260] T 4e7bbbf891cd4500a8ec7f3d21905240 P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.398206 22282 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38088:
name: "default.Table_732a1b16caff489aa844bba46e6ec1cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:09.399312 23392 ts_tablet_manager.cc:1434] T 4e7bbbf891cd4500a8ec7f3d21905240 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20260808 20:00:09.402837 23392 tablet_bootstrap.cc:492] T a89c8105460e45f9a77af8c7cf84607c P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:09.404806 23392 tablet_bootstrap.cc:654] T a89c8105460e45f9a77af8c7cf84607c P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
W20260808 20:00:09.410866 22288 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_4dc166b247ee4cf89cdd926e07b51a51 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260808 20:00:09.411818 22277 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_3ffa098d41af4ebb987cec463feb8e76 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260808 20:00:09.412878 22287 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_530ab728450b4272b3e9573534afe4e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 20:00:09.414595 21649 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu
/tmp/dist-test-taskNcG5N9/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.36.126:43945
--webserver_interface=127.21.36.126
--webserver_port=37243
--builtin_ntp_servers=127.21.36.84:34883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593
--hive_metastore_uris=thrift://127.0.0.1:44789
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260808 20:00:09.417158 23392 tablet_bootstrap.cc:492] T a89c8105460e45f9a77af8c7cf84607c P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:09.417325 23392 ts_tablet_manager.cc:1403] T a89c8105460e45f9a77af8c7cf84607c P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.004s
I20260808 20:00:09.418179 23392 raft_consensus.cc:359] T a89c8105460e45f9a77af8c7cf84607c P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:09.418375 23392 raft_consensus.cc:385] T a89c8105460e45f9a77af8c7cf84607c P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:09.418453 23392 raft_consensus.cc:740] T a89c8105460e45f9a77af8c7cf84607c P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:09.418767 23392 consensus_queue.cc:260] T a89c8105460e45f9a77af8c7cf84607c P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:09.422060 23392 ts_tablet_manager.cc:1434] T a89c8105460e45f9a77af8c7cf84607c P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20260808 20:00:09.428377 22678 tablet_service.cc:1511] Processing CreateTablet for tablet 6ceb53121b5247b7ac83292c4c2d5416 (DEFAULT_TABLE table=default.table_324c660111c84a72a6935eb8e30a7ae6 [id=06447c1e53ac4366baae14ef41588d7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:09.428648 22908 tablet_service.cc:1511] Processing CreateTablet for tablet 6ceb53121b5247b7ac83292c4c2d5416 (DEFAULT_TABLE table=default.table_324c660111c84a72a6935eb8e30a7ae6 [id=06447c1e53ac4366baae14ef41588d7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:09.428941 22678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ceb53121b5247b7ac83292c4c2d5416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:09.429057 22908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ceb53121b5247b7ac83292c4c2d5416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:09.435770 23386 tablet_bootstrap.cc:492] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:09.436558 23146 tablet_service.cc:1511] Processing CreateTablet for tablet 6ceb53121b5247b7ac83292c4c2d5416 (DEFAULT_TABLE table=default.table_324c660111c84a72a6935eb8e30a7ae6 [id=06447c1e53ac4366baae14ef41588d7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:09.437064 23146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ceb53121b5247b7ac83292c4c2d5416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:09.437701 23386 tablet_bootstrap.cc:654] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:09.453068 23392 tablet_bootstrap.cc:492] T 6ceb53121b5247b7ac83292c4c2d5416 P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:09.454170 23384 tablet_bootstrap.cc:492] T 6ceb53121b5247b7ac83292c4c2d5416 P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:09.455077 23392 tablet_bootstrap.cc:654] T 6ceb53121b5247b7ac83292c4c2d5416 P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:09.455412 22281 catalog_manager.cc:2200] created HMS catalog entry for table [id=b47087e2cd6349b1ba2b8daf55b2d1d5]
I20260808 20:00:09.456069 23384 tablet_bootstrap.cc:654] T 6ceb53121b5247b7ac83292c4c2d5416 P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:09.456480 23386 tablet_bootstrap.cc:492] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:09.456707 23386 ts_tablet_manager.cc:1403] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.007s
I20260808 20:00:09.457918 23386 raft_consensus.cc:359] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.458168 23386 raft_consensus.cc:385] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:09.458271 23386 raft_consensus.cc:740] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:09.459450 23386 consensus_queue.cc:260] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.460328 23386 ts_tablet_manager.cc:1434] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260808 20:00:09.468454 22281 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:38088 (request call id 7) took 1244 ms. Trace:
I20260808 20:00:09.468650 22281 rpcz_store.cc:276] 0808 20:00:08.224098 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:08.224165 (+ 67us) service_pool.cc:224] Handling call
0808 20:00:09.380588 (+1156423us) catalog_manager.cc:2127] Acquired catalog manager lock
0808 20:00:09.381176 (+ 588us) catalog_manager.cc:2173] Created new table and tablet info
0808 20:00:09.455344 (+ 74168us) catalog_manager.cc:2199] Created new table in HMS catalog
0808 20:00:09.468126 (+ 12782us) catalog_manager.cc:2233] Wrote table and tablets to system table
0808 20:00:09.468254 (+ 128us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0808 20:00:09.468391 (+ 137us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0808 20:00:09.456918 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0808 20:00:09.457082 (+ 164us) write_op.cc:432] Acquiring schema lock in shared mode
0808 20:00:09.457090 (+ 8us) write_op.cc:435] Acquired schema lock
0808 20:00:09.457092 (+ 2us) tablet.cc:662] Decoding operations
0808 20:00:09.457197 (+ 105us) write_op.cc:620] Acquiring the partition lock for write op
0808 20:00:09.457211 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0808 20:00:09.457216 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0808 20:00:09.457310 (+ 94us) tablet.cc:701] Row locks acquired
0808 20:00:09.457312 (+ 2us) write_op.cc:260] PREPARE: finished
0808 20:00:09.457365 (+ 53us) write_op.cc:270] Start()
0808 20:00:09.457407 (+ 42us) write_op.cc:276] Timestamp: P: 1786219209457335 usec, L: 0
0808 20:00:09.457411 (+ 4us) op_driver.cc:348] REPLICATION: starting
0808 20:00:09.457663 (+ 252us) log.cc:844] Serialized 432 byte log entry
0808 20:00:09.467251 (+ 9588us) op_driver.cc:464] REPLICATION: finished
0808 20:00:09.467431 (+ 180us) write_op.cc:301] APPLY: starting
0808 20:00:09.467452 (+ 21us) tablet.cc:1367] starting BulkCheckPresence
0808 20:00:09.467528 (+ 76us) tablet.cc:1370] finished BulkCheckPresence
0808 20:00:09.467579 (+ 51us) tablet.cc:1372] starting ApplyRowOperation cycle
0808 20:00:09.467733 (+ 154us) tablet.cc:1383] finished ApplyRowOperation cycle
0808 20:00:09.467788 (+ 55us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0808 20:00:09.467797 (+ 9us) write_op.cc:312] APPLY: finished
0808 20:00:09.467922 (+ 125us) log.cc:844] Serialized 28 byte log entry
0808 20:00:09.468005 (+ 83us) write_op.cc:489] Releasing partition, row and schema locks
0808 20:00:09.468030 (+ 25us) write_op.cc:454] Released schema lock
0808 20:00:09.468038 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0808 20:00:09.468125 (+ 87us) write_op.cc:489] Releasing partition, row and schema locks
0808 20:00:09.468129 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":19044,"Hive Metastore.run_cpu_time_us":299,"Hive Metastore.run_wall_time_us":54739,"child_traces":[["op",{"apply.queue_time_us":123,"apply.run_cpu_time_us":683,"apply.run_wall_time_us":683,"num_ops":2,"prepare.queue_time_us":542,"prepare.run_cpu_time_us":912,"prepare.run_wall_time_us":1888,"raft.queue_time_us":503,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":361,"replication_time_us":9800}]]}
W20260808 20:00:09.478673 22282 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_732a1b16caff489aa844bba46e6ec1cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 20:00:09.481154 23392 tablet_bootstrap.cc:492] T 6ceb53121b5247b7ac83292c4c2d5416 P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:09.481395 23392 ts_tablet_manager.cc:1403] T 6ceb53121b5247b7ac83292c4c2d5416 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.007s
I20260808 20:00:09.482286 23392 raft_consensus.cc:359] T 6ceb53121b5247b7ac83292c4c2d5416 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.482529 23392 raft_consensus.cc:385] T 6ceb53121b5247b7ac83292c4c2d5416 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:09.482604 23392 raft_consensus.cc:740] T 6ceb53121b5247b7ac83292c4c2d5416 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:09.482879 22678 tablet_service.cc:1511] Processing CreateTablet for tablet d1c720d7dc8e4b8184ffc863a22cf9e3 (DEFAULT_TABLE table=default.table_831d17f2742e4fb8bc727d56fc9d1c85 [id=b47087e2cd6349b1ba2b8daf55b2d1d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:09.482918 23392 consensus_queue.cc:260] T 6ceb53121b5247b7ac83292c4c2d5416 P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.483382 22678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1c720d7dc8e4b8184ffc863a22cf9e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:09.483559 22281 catalog_manager.cc:5719] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65). New cstate: current_term: 1 leader_uuid: "257c9c7e0c6c441593eac06beb31fa4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } health_report { overall_health: UNKNOWN } } }
I20260808 20:00:09.487936 23392 ts_tablet_manager.cc:1434] T 6ceb53121b5247b7ac83292c4c2d5416 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260808 20:00:09.489037 23144 tablet_service.cc:1511] Processing CreateTablet for tablet d1c720d7dc8e4b8184ffc863a22cf9e3 (DEFAULT_TABLE table=default.table_831d17f2742e4fb8bc727d56fc9d1c85 [id=b47087e2cd6349b1ba2b8daf55b2d1d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:09.489493 23144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1c720d7dc8e4b8184ffc863a22cf9e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:09.492898 22906 tablet_service.cc:1511] Processing CreateTablet for tablet d1c720d7dc8e4b8184ffc863a22cf9e3 (DEFAULT_TABLE table=default.table_831d17f2742e4fb8bc727d56fc9d1c85 [id=b47087e2cd6349b1ba2b8daf55b2d1d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:09.493394 22906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1c720d7dc8e4b8184ffc863a22cf9e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:09.516768 22281 master_service.cc:960] ReplaceTablet: received request to replace tablet da812f335dcb4de9953235f8a9bb4fc4 from {username='slave'} at 127.0.0.1:38088
I20260808 20:00:09.527400 23386 tablet_bootstrap.cc:492] T d1c720d7dc8e4b8184ffc863a22cf9e3 P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:09.528187 23392 tablet_bootstrap.cc:492] T d1c720d7dc8e4b8184ffc863a22cf9e3 P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:09.529435 23386 tablet_bootstrap.cc:654] T d1c720d7dc8e4b8184ffc863a22cf9e3 P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:09.529942 23392 tablet_bootstrap.cc:654] T d1c720d7dc8e4b8184ffc863a22cf9e3 P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:09.532226 22281 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6: Sending DeleteTablet for 3 replicas of tablet da812f335dcb4de9953235f8a9bb4fc4
I20260808 20:00:09.533329 22676 tablet_service.cc:1558] Processing DeleteTablet for tablet da812f335dcb4de9953235f8a9bb4fc4 with delete_type TABLET_DATA_DELETED (replaced by tablet b45729e2ec9e4a77b8be89f9657b0424) from {username='slave'} at 127.0.0.1:43572
I20260808 20:00:09.533668 23407 tablet_replica.cc:333] T da812f335dcb4de9953235f8a9bb4fc4 P 257c9c7e0c6c441593eac06beb31fa4e: stopping tablet replica
I20260808 20:00:09.533905 23407 raft_consensus.cc:2243] T da812f335dcb4de9953235f8a9bb4fc4 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:09.534068 23407 raft_consensus.cc:2272] T da812f335dcb4de9953235f8a9bb4fc4 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:09.535003 23407 ts_tablet_manager.cc:1916] T da812f335dcb4de9953235f8a9bb4fc4 P 257c9c7e0c6c441593eac06beb31fa4e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:09.535866 23143 tablet_service.cc:1558] Processing DeleteTablet for tablet da812f335dcb4de9953235f8a9bb4fc4 with delete_type TABLET_DATA_DELETED (replaced by tablet b45729e2ec9e4a77b8be89f9657b0424) from {username='slave'} at 127.0.0.1:60086
I20260808 20:00:09.536219 23409 tablet_replica.cc:333] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9: stopping tablet replica
I20260808 20:00:09.536437 23409 raft_consensus.cc:2243] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 LEADER]: Raft consensus shutting down.
I20260808 20:00:09.536968 23409 pending_rounds.cc:70] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9: Trying to abort 1 pending ops.
I20260808 20:00:09.537191 23409 pending_rounds.cc:77] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316353881243209728 op_type: NO_OP noop_request { }
I20260808 20:00:09.537413 23409 raft_consensus.cc:2889] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260808 20:00:09.537557 23409 raft_consensus.cc:2272] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:09.538445 23394 raft_consensus.cc:493] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:09.538632 23394 raft_consensus.cc:515] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:09.539445 23394 leader_election.cc:290] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:09.540742 22938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a89c8105460e45f9a77af8c7cf84607c" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653" is_pre_election: true
I20260808 20:00:09.540980 22938 raft_consensus.cc:2468] T a89c8105460e45f9a77af8c7cf84607c P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 0.
I20260808 20:00:09.541812 23179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a89c8105460e45f9a77af8c7cf84607c" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9" is_pre_election: true
I20260808 20:00:09.542064 23179 raft_consensus.cc:2468] T a89c8105460e45f9a77af8c7cf84607c P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 0.
I20260808 20:00:09.542125 23407 ts_tablet_manager.cc:1929] T da812f335dcb4de9953235f8a9bb4fc4 P 257c9c7e0c6c441593eac06beb31fa4e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260808 20:00:09.542280 23407 log.cc:1199] T da812f335dcb4de9953235f8a9bb4fc4 P 257c9c7e0c6c441593eac06beb31fa4e: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-0/wal/wals/da812f335dcb4de9953235f8a9bb4fc4
I20260808 20:00:09.542472 22604 leader_election.cc:304] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:09.542701 23407 ts_tablet_manager.cc:1950] T da812f335dcb4de9953235f8a9bb4fc4 P 257c9c7e0c6c441593eac06beb31fa4e: Deleting consensus metadata
I20260808 20:00:09.543434 23394 raft_consensus.cc:2804] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:09.543582 23394 raft_consensus.cc:493] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:09.543681 23394 raft_consensus.cc:3060] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:09.544483 22281 catalog_manager.cc:6807] ReplaceTablet: tablet da812f335dcb4de9953235f8a9bb4fc4 deleted and replaced by tablet b45729e2ec9e4a77b8be89f9657b0424
I20260808 20:00:09.549326 23394 raft_consensus.cc:515] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:09.551246 23179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a89c8105460e45f9a77af8c7cf84607c" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9"
I20260808 20:00:09.551533 23179 raft_consensus.cc:3060] T a89c8105460e45f9a77af8c7cf84607c P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:09.554437 23179 raft_consensus.cc:2468] T a89c8105460e45f9a77af8c7cf84607c P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 1.
I20260808 20:00:09.555058 22607 leader_election.cc:304] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, 5f6b6c2e318d44a984120a06a09e9af9; no voters:
I20260808 20:00:09.556872 22938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a89c8105460e45f9a77af8c7cf84607c" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653"
I20260808 20:00:09.557109 22938 raft_consensus.cc:3060] T a89c8105460e45f9a77af8c7cf84607c P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:09.560117 22265 catalog_manager.cc:5050] TS 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): tablet da812f335dcb4de9953235f8a9bb4fc4 (table default.table_6ac9f69790254374990cc94411d04422 [id=43498092c52a457d93f97ba0993e6012]) successfully deleted
I20260808 20:00:09.560596 23394 leader_election.cc:290] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 election: Requested vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:09.560977 23394 raft_consensus.cc:2804] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:09.562529 23394 raft_consensus.cc:697] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e [term 1 LEADER]: Becoming Leader. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Running, Role: LEADER
I20260808 20:00:09.562726 23384 tablet_bootstrap.cc:492] T 6ceb53121b5247b7ac83292c4c2d5416 P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:09.562913 23384 ts_tablet_manager.cc:1403] T 6ceb53121b5247b7ac83292c4c2d5416 P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.109s user 0.005s sys 0.005s
I20260808 20:00:09.563792 23384 raft_consensus.cc:359] T 6ceb53121b5247b7ac83292c4c2d5416 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.564050 23384 raft_consensus.cc:385] T 6ceb53121b5247b7ac83292c4c2d5416 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:09.564152 23384 raft_consensus.cc:740] T 6ceb53121b5247b7ac83292c4c2d5416 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:09.564059 22938 raft_consensus.cc:2468] T a89c8105460e45f9a77af8c7cf84607c P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 1.
I20260808 20:00:09.564438 23384 consensus_queue.cc:260] T 6ceb53121b5247b7ac83292c4c2d5416 P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.564962 23384 ts_tablet_manager.cc:1434] T 6ceb53121b5247b7ac83292c4c2d5416 P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260808 20:00:09.565346 23384 tablet_bootstrap.cc:492] T d1c720d7dc8e4b8184ffc863a22cf9e3 P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:09.567224 23384 tablet_bootstrap.cc:654] T d1c720d7dc8e4b8184ffc863a22cf9e3 P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:09.571365 23409 ts_tablet_manager.cc:1916] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:09.578435 23394 consensus_queue.cc:237] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:09.587062 22908 tablet_service.cc:1558] Processing DeleteTablet for tablet da812f335dcb4de9953235f8a9bb4fc4 with delete_type TABLET_DATA_DELETED (replaced by tablet b45729e2ec9e4a77b8be89f9657b0424) from {username='slave'} at 127.0.0.1:58148
I20260808 20:00:09.590090 23408 tablet_replica.cc:333] T da812f335dcb4de9953235f8a9bb4fc4 P e34d5caee97d44fa945a91ddc6a54653: stopping tablet replica
I20260808 20:00:09.590425 23408 raft_consensus.cc:2243] T da812f335dcb4de9953235f8a9bb4fc4 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:09.590684 23408 raft_consensus.cc:2272] T da812f335dcb4de9953235f8a9bb4fc4 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:09.591667 23408 ts_tablet_manager.cc:1916] T da812f335dcb4de9953235f8a9bb4fc4 P e34d5caee97d44fa945a91ddc6a54653: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:09.598281 23408 ts_tablet_manager.cc:1929] T da812f335dcb4de9953235f8a9bb4fc4 P e34d5caee97d44fa945a91ddc6a54653: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260808 20:00:09.598467 23408 log.cc:1199] T da812f335dcb4de9953235f8a9bb4fc4 P e34d5caee97d44fa945a91ddc6a54653: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/wal/wals/da812f335dcb4de9953235f8a9bb4fc4
I20260808 20:00:09.598839 23408 ts_tablet_manager.cc:1950] T da812f335dcb4de9953235f8a9bb4fc4 P e34d5caee97d44fa945a91ddc6a54653: Deleting consensus metadata
I20260808 20:00:09.600013 22265 catalog_manager.cc:5050] TS e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): tablet da812f335dcb4de9953235f8a9bb4fc4 (table default.table_6ac9f69790254374990cc94411d04422 [id=43498092c52a457d93f97ba0993e6012]) successfully deleted
I20260808 20:00:09.607180 22678 tablet_service.cc:1511] Processing CreateTablet for tablet b45729e2ec9e4a77b8be89f9657b0424 (DEFAULT_TABLE table=default.table_6ac9f69790254374990cc94411d04422 [id=43498092c52a457d93f97ba0993e6012]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:09.607932 22678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b45729e2ec9e4a77b8be89f9657b0424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:09.615181 22908 tablet_service.cc:1511] Processing CreateTablet for tablet b45729e2ec9e4a77b8be89f9657b0424 (DEFAULT_TABLE table=default.table_6ac9f69790254374990cc94411d04422 [id=43498092c52a457d93f97ba0993e6012]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:09.615805 22908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b45729e2ec9e4a77b8be89f9657b0424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:09.582578 23409 ts_tablet_manager.cc:1929] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260808 20:00:09.620965 23409 log.cc:1199] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/wal/wals/da812f335dcb4de9953235f8a9bb4fc4
I20260808 20:00:09.622778 23144 tablet_service.cc:1511] Processing CreateTablet for tablet b45729e2ec9e4a77b8be89f9657b0424 (DEFAULT_TABLE table=default.table_6ac9f69790254374990cc94411d04422 [id=43498092c52a457d93f97ba0993e6012]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:09.623296 23144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b45729e2ec9e4a77b8be89f9657b0424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:09.624096 23409 ts_tablet_manager.cc:1950] T da812f335dcb4de9953235f8a9bb4fc4 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting consensus metadata
I20260808 20:00:09.625537 22268 catalog_manager.cc:5050] TS 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): tablet da812f335dcb4de9953235f8a9bb4fc4 (table default.table_6ac9f69790254374990cc94411d04422 [id=43498092c52a457d93f97ba0993e6012]) successfully deleted
I20260808 20:00:09.625972 22281 catalog_manager.cc:5719] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65). New cstate: current_term: 1 leader_uuid: "257c9c7e0c6c441593eac06beb31fa4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } health_report { overall_health: HEALTHY } } }
I20260808 20:00:09.638377 22281 master_service.cc:960] ReplaceTablet: received request to replace tablet da812f335dcb4de9953235f8a9bb4fc4 from {username='slave'} at 127.0.0.1:38088
I20260808 20:00:09.639889 22281 master_service.cc:960] ReplaceTablet: received request to replace tablet 2a7b98025dbf45a0881271da78fe29c0 from {username='slave'} at 127.0.0.1:38088
I20260808 20:00:09.649207 23386 tablet_bootstrap.cc:492] T d1c720d7dc8e4b8184ffc863a22cf9e3 P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:09.649441 23386 ts_tablet_manager.cc:1403] T d1c720d7dc8e4b8184ffc863a22cf9e3 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.122s user 0.007s sys 0.001s
I20260808 20:00:09.650434 23386 raft_consensus.cc:359] T d1c720d7dc8e4b8184ffc863a22cf9e3 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.650686 23386 raft_consensus.cc:385] T d1c720d7dc8e4b8184ffc863a22cf9e3 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:09.650779 23386 raft_consensus.cc:740] T d1c720d7dc8e4b8184ffc863a22cf9e3 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:09.651117 23386 consensus_queue.cc:260] T d1c720d7dc8e4b8184ffc863a22cf9e3 P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.651763 23386 ts_tablet_manager.cc:1434] T d1c720d7dc8e4b8184ffc863a22cf9e3 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260808 20:00:09.665130 23394 raft_consensus.cc:493] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:09.665345 23394 raft_consensus.cc:515] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.666626 23179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ceb53121b5247b7ac83292c4c2d5416" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9" is_pre_election: true
I20260808 20:00:09.666877 23179 raft_consensus.cc:2468] T 6ceb53121b5247b7ac83292c4c2d5416 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 0.
I20260808 20:00:09.666870 22938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ceb53121b5247b7ac83292c4c2d5416" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653" is_pre_election: true
I20260808 20:00:09.667124 22938 raft_consensus.cc:2468] T 6ceb53121b5247b7ac83292c4c2d5416 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 0.
I20260808 20:00:09.667675 23394 leader_election.cc:290] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:09.667622 22607 leader_election.cc:304] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, 5f6b6c2e318d44a984120a06a09e9af9; no voters:
I20260808 20:00:09.668476 23394 raft_consensus.cc:2804] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:09.668661 23394 raft_consensus.cc:493] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:09.668809 23394 raft_consensus.cc:3060] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:09.673020 23394 raft_consensus.cc:515] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.674288 23179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ceb53121b5247b7ac83292c4c2d5416" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9"
I20260808 20:00:09.674501 23179 raft_consensus.cc:3060] T 6ceb53121b5247b7ac83292c4c2d5416 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:09.677340 23179 raft_consensus.cc:2468] T 6ceb53121b5247b7ac83292c4c2d5416 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 1.
I20260808 20:00:09.678095 22607 leader_election.cc:304] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, 5f6b6c2e318d44a984120a06a09e9af9; no voters:
I20260808 20:00:09.678491 23464 raft_consensus.cc:493] T 78ab65d40a004ef9888b6577716b783c P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:09.678644 23464 raft_consensus.cc:515] T 78ab65d40a004ef9888b6577716b783c P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:09.679517 23464 leader_election.cc:290] T 78ab65d40a004ef9888b6577716b783c P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:09.679720 23464 raft_consensus.cc:2804] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:09.679847 23464 raft_consensus.cc:697] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 LEADER]: Becoming Leader. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Running, Role: LEADER
I20260808 20:00:09.679996 22281 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6: Sending DeleteTablet for 3 replicas of tablet 2a7b98025dbf45a0881271da78fe29c0
I20260808 20:00:09.680122 23464 consensus_queue.cc:237] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.681253 23144 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a7b98025dbf45a0881271da78fe29c0 with delete_type TABLET_DATA_DELETED (replaced by tablet d60be8ef6e8642388691bb0cd3ab2ada) from {username='slave'} at 127.0.0.1:60086
I20260808 20:00:09.682153 22676 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a7b98025dbf45a0881271da78fe29c0 with delete_type TABLET_DATA_DELETED (replaced by tablet d60be8ef6e8642388691bb0cd3ab2ada) from {username='slave'} at 127.0.0.1:43572
I20260808 20:00:09.682480 22906 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a7b98025dbf45a0881271da78fe29c0 with delete_type TABLET_DATA_DELETED (replaced by tablet d60be8ef6e8642388691bb0cd3ab2ada) from {username='slave'} at 127.0.0.1:58148
I20260808 20:00:09.682811 22938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ab65d40a004ef9888b6577716b783c" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653" is_pre_election: true
I20260808 20:00:09.683048 22938 raft_consensus.cc:2468] T 78ab65d40a004ef9888b6577716b783c P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 0.
I20260808 20:00:09.683434 23407 tablet_replica.cc:333] T 2a7b98025dbf45a0881271da78fe29c0 P 257c9c7e0c6c441593eac06beb31fa4e: stopping tablet replica
I20260808 20:00:09.683671 23407 raft_consensus.cc:2243] T 2a7b98025dbf45a0881271da78fe29c0 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:09.683854 23407 raft_consensus.cc:2272] T 2a7b98025dbf45a0881271da78fe29c0 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:09.684422 23407 ts_tablet_manager.cc:1916] T 2a7b98025dbf45a0881271da78fe29c0 P 257c9c7e0c6c441593eac06beb31fa4e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:09.687661 23408 tablet_replica.cc:333] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653: stopping tablet replica
I20260808 20:00:09.687867 23408 raft_consensus.cc:2243] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653 [term 1 LEADER]: Raft consensus shutting down.
I20260808 20:00:09.688380 23408 pending_rounds.cc:70] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653: Trying to abort 1 pending ops.
I20260808 20:00:09.688577 23408 pending_rounds.cc:77] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316353880940208128 op_type: NO_OP noop_request { }
I20260808 20:00:09.688803 23408 raft_consensus.cc:2889] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260808 20:00:09.688937 23408 raft_consensus.cc:2272] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:09.689952 22604 leader_election.cc:304] T 78ab65d40a004ef9888b6577716b783c P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:09.690158 23408 ts_tablet_manager.cc:1916] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:09.690572 23461 raft_consensus.cc:2804] T 78ab65d40a004ef9888b6577716b783c P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:09.690699 23461 raft_consensus.cc:493] T 78ab65d40a004ef9888b6577716b783c P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:09.690809 23461 raft_consensus.cc:3060] T 78ab65d40a004ef9888b6577716b783c P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:09.692739 22906 tablet_service.cc:1511] Processing CreateTablet for tablet d60be8ef6e8642388691bb0cd3ab2ada (DEFAULT_TABLE table=default.table_b5f73af0927644749fde95d4e9e1bc95 [id=6ab57419bd7a4e3e97816482d3eab619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:09.693188 22906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d60be8ef6e8642388691bb0cd3ab2ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:09.693686 23461 raft_consensus.cc:515] T 78ab65d40a004ef9888b6577716b783c P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:09.694345 23461 leader_election.cc:290] T 78ab65d40a004ef9888b6577716b783c P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 election: Requested vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:09.696301 23177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ab65d40a004ef9888b6577716b783c" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9" is_pre_election: true
I20260808 20:00:09.696493 23176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ab65d40a004ef9888b6577716b783c" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9"
I20260808 20:00:09.696667 23177 raft_consensus.cc:2468] T 78ab65d40a004ef9888b6577716b783c P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 0.
I20260808 20:00:09.697237 23408 ts_tablet_manager.cc:1929] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260808 20:00:09.697404 23408 log.cc:1199] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/wal/wals/2a7b98025dbf45a0881271da78fe29c0
I20260808 20:00:09.697858 23408 ts_tablet_manager.cc:1950] T 2a7b98025dbf45a0881271da78fe29c0 P e34d5caee97d44fa945a91ddc6a54653: Deleting consensus metadata
I20260808 20:00:09.703003 22281 catalog_manager.cc:6807] ReplaceTablet: tablet 2a7b98025dbf45a0881271da78fe29c0 deleted and replaced by tablet d60be8ef6e8642388691bb0cd3ab2ada
I20260808 20:00:09.703388 23144 tablet_service.cc:1511] Processing CreateTablet for tablet d60be8ef6e8642388691bb0cd3ab2ada (DEFAULT_TABLE table=default.table_b5f73af0927644749fde95d4e9e1bc95 [id=6ab57419bd7a4e3e97816482d3eab619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:09.703914 23144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d60be8ef6e8642388691bb0cd3ab2ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:09.704785 22265 catalog_manager.cc:5050] TS e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): tablet 2a7b98025dbf45a0881271da78fe29c0 (table default.table_b5f73af0927644749fde95d4e9e1bc95 [id=6ab57419bd7a4e3e97816482d3eab619]) successfully deleted
I20260808 20:00:09.705207 23386 tablet_bootstrap.cc:492] T b45729e2ec9e4a77b8be89f9657b0424 P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:09.707104 23386 tablet_bootstrap.cc:654] T b45729e2ec9e4a77b8be89f9657b0424 P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:09.710866 22938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ab65d40a004ef9888b6577716b783c" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653"
I20260808 20:00:09.711149 22938 raft_consensus.cc:3060] T 78ab65d40a004ef9888b6577716b783c P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:09.711877 22678 tablet_service.cc:1511] Processing CreateTablet for tablet d60be8ef6e8642388691bb0cd3ab2ada (DEFAULT_TABLE table=default.table_b5f73af0927644749fde95d4e9e1bc95 [id=6ab57419bd7a4e3e97816482d3eab619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:09.712469 22281 master_service.cc:960] ReplaceTablet: received request to replace tablet 2a7b98025dbf45a0881271da78fe29c0 from {username='slave'} at 127.0.0.1:38088
I20260808 20:00:09.713824 22281 master_service.cc:960] ReplaceTablet: received request to replace tablet 2a7b98025dbf45a0881271da78fe29c0 from {username='slave'} at 127.0.0.1:38088
I20260808 20:00:09.714578 22938 raft_consensus.cc:2468] T 78ab65d40a004ef9888b6577716b783c P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 1.
I20260808 20:00:09.715327 22604 leader_election.cc:304] T 78ab65d40a004ef9888b6577716b783c P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, e34d5caee97d44fa945a91ddc6a54653; no voters: 5f6b6c2e318d44a984120a06a09e9af9
I20260808 20:00:09.715696 22281 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38088:
table { table_name: "default.Table_f4c950a229114bde8c62335c66af32ed" } modify_external_catalogs: true
I20260808 20:00:09.715785 23488 raft_consensus.cc:2804] T 78ab65d40a004ef9888b6577716b783c P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:09.715929 22281 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38088:
table { table_name: "default.Table_f4c950a229114bde8c62335c66af32ed" } modify_external_catalogs: true
I20260808 20:00:09.715962 23488 raft_consensus.cc:697] T 78ab65d40a004ef9888b6577716b783c P 257c9c7e0c6c441593eac06beb31fa4e [term 1 LEADER]: Becoming Leader. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Running, Role: LEADER
I20260808 20:00:09.716401 23488 consensus_queue.cc:237] T 78ab65d40a004ef9888b6577716b783c P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:09.719874 23409 tablet_replica.cc:333] T 2a7b98025dbf45a0881271da78fe29c0 P 5f6b6c2e318d44a984120a06a09e9af9: stopping tablet replica
I20260808 20:00:09.720196 23409 raft_consensus.cc:2243] T 2a7b98025dbf45a0881271da78fe29c0 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:09.720458 23409 raft_consensus.cc:2272] T 2a7b98025dbf45a0881271da78fe29c0 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:09.721138 23386 tablet_bootstrap.cc:492] T b45729e2ec9e4a77b8be89f9657b0424 P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:09.721338 23386 ts_tablet_manager.cc:1403] T b45729e2ec9e4a77b8be89f9657b0424 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.001s
I20260808 20:00:09.721333 23409 ts_tablet_manager.cc:1916] T 2a7b98025dbf45a0881271da78fe29c0 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:09.722236 23386 raft_consensus.cc:359] T b45729e2ec9e4a77b8be89f9657b0424 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.722450 23386 raft_consensus.cc:385] T b45729e2ec9e4a77b8be89f9657b0424 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:09.722529 23386 raft_consensus.cc:740] T b45729e2ec9e4a77b8be89f9657b0424 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:09.722841 23386 consensus_queue.cc:260] T b45729e2ec9e4a77b8be89f9657b0424 P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.723434 23386 ts_tablet_manager.cc:1434] T b45729e2ec9e4a77b8be89f9657b0424 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260808 20:00:09.723780 23407 ts_tablet_manager.cc:1929] T 2a7b98025dbf45a0881271da78fe29c0 P 257c9c7e0c6c441593eac06beb31fa4e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260808 20:00:09.723954 22678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d60be8ef6e8642388691bb0cd3ab2ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:09.724260 23407 log.cc:1199] T 2a7b98025dbf45a0881271da78fe29c0 P 257c9c7e0c6c441593eac06beb31fa4e: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-0/wal/wals/2a7b98025dbf45a0881271da78fe29c0
I20260808 20:00:09.726068 23407 ts_tablet_manager.cc:1950] T 2a7b98025dbf45a0881271da78fe29c0 P 257c9c7e0c6c441593eac06beb31fa4e: Deleting consensus metadata
I20260808 20:00:09.727859 22265 catalog_manager.cc:5050] TS 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): tablet 2a7b98025dbf45a0881271da78fe29c0 (table default.table_b5f73af0927644749fde95d4e9e1bc95 [id=6ab57419bd7a4e3e97816482d3eab619]) successfully deleted
I20260808 20:00:09.731251 23392 tablet_bootstrap.cc:492] T d1c720d7dc8e4b8184ffc863a22cf9e3 P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:09.731451 23392 ts_tablet_manager.cc:1403] T d1c720d7dc8e4b8184ffc863a22cf9e3 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.203s user 0.012s sys 0.023s
I20260808 20:00:09.732460 23392 raft_consensus.cc:359] T d1c720d7dc8e4b8184ffc863a22cf9e3 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.732679 23392 raft_consensus.cc:385] T d1c720d7dc8e4b8184ffc863a22cf9e3 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:09.732779 23392 raft_consensus.cc:740] T d1c720d7dc8e4b8184ffc863a22cf9e3 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:09.733075 23392 consensus_queue.cc:260] T d1c720d7dc8e4b8184ffc863a22cf9e3 P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.733603 23392 ts_tablet_manager.cc:1434] T d1c720d7dc8e4b8184ffc863a22cf9e3 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260808 20:00:09.742889 23386 tablet_bootstrap.cc:492] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:09.744218 23392 tablet_bootstrap.cc:492] T b45729e2ec9e4a77b8be89f9657b0424 P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:09.745085 23386 tablet_bootstrap.cc:654] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:09.745281 22938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ceb53121b5247b7ac83292c4c2d5416" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653"
I20260808 20:00:09.745504 22938 raft_consensus.cc:3060] T 6ceb53121b5247b7ac83292c4c2d5416 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:09.748595 22938 raft_consensus.cc:2468] T 6ceb53121b5247b7ac83292c4c2d5416 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 1.
I20260808 20:00:09.751206 23461 raft_consensus.cc:493] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:09.751443 23461 raft_consensus.cc:515] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.752300 23461 leader_election.cc:290] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:09.751200 23394 leader_election.cc:290] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 election: Requested vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:09.753476 23179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7117a3852b424a2d83a00b4ebab727cf" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9" is_pre_election: true
I20260808 20:00:09.753829 23179 raft_consensus.cc:2468] T 7117a3852b424a2d83a00b4ebab727cf P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 0.
I20260808 20:00:09.753888 23386 tablet_bootstrap.cc:492] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:09.754035 23386 ts_tablet_manager.cc:1403] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.003s
I20260808 20:00:09.754423 22607 leader_election.cc:304] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, 5f6b6c2e318d44a984120a06a09e9af9; no voters:
I20260808 20:00:09.754974 22938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7117a3852b424a2d83a00b4ebab727cf" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653" is_pre_election: true
I20260808 20:00:09.755033 23386 raft_consensus.cc:359] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.755235 23386 raft_consensus.cc:385] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:09.755329 23386 raft_consensus.cc:740] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:09.755450 22938 raft_consensus.cc:2468] T 7117a3852b424a2d83a00b4ebab727cf P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 0.
I20260808 20:00:09.755681 23386 consensus_queue.cc:260] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.756006 23461 raft_consensus.cc:2804] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:09.756134 23461 raft_consensus.cc:493] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:09.756243 23461 raft_consensus.cc:3060] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:09.760165 23461 raft_consensus.cc:515] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.761125 23461 leader_election.cc:290] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 election: Requested vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:09.761771 23386 ts_tablet_manager.cc:1434] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.008s user 0.000s sys 0.003s
I20260808 20:00:09.763836 23179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7117a3852b424a2d83a00b4ebab727cf" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9"
I20260808 20:00:09.764510 23179 raft_consensus.cc:3060] T 7117a3852b424a2d83a00b4ebab727cf P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:09.767866 22938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7117a3852b424a2d83a00b4ebab727cf" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653"
I20260808 20:00:09.774596 22938 raft_consensus.cc:3060] T 7117a3852b424a2d83a00b4ebab727cf P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:09.777094 23179 raft_consensus.cc:2468] T 7117a3852b424a2d83a00b4ebab727cf P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 1.
I20260808 20:00:09.778294 22607 leader_election.cc:304] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, 5f6b6c2e318d44a984120a06a09e9af9; no voters:
I20260808 20:00:09.778852 23394 raft_consensus.cc:2804] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:09.779022 23394 raft_consensus.cc:697] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e [term 1 LEADER]: Becoming Leader. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Running, Role: LEADER
I20260808 20:00:09.779310 23394 consensus_queue.cc:237] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.787161 22938 raft_consensus.cc:2468] T 7117a3852b424a2d83a00b4ebab727cf P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 1.
I20260808 20:00:09.789685 23392 tablet_bootstrap.cc:654] T b45729e2ec9e4a77b8be89f9657b0424 P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:09.792814 23384 tablet_bootstrap.cc:492] T d1c720d7dc8e4b8184ffc863a22cf9e3 P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:09.802524 23384 ts_tablet_manager.cc:1403] T d1c720d7dc8e4b8184ffc863a22cf9e3 P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.237s user 0.010s sys 0.015s
I20260808 20:00:09.803552 23384 raft_consensus.cc:359] T d1c720d7dc8e4b8184ffc863a22cf9e3 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.804553 23409 ts_tablet_manager.cc:1929] T 2a7b98025dbf45a0881271da78fe29c0 P 5f6b6c2e318d44a984120a06a09e9af9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260808 20:00:09.804886 23384 raft_consensus.cc:385] T d1c720d7dc8e4b8184ffc863a22cf9e3 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:09.807615 23384 raft_consensus.cc:740] T d1c720d7dc8e4b8184ffc863a22cf9e3 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:09.808007 23409 log.cc:1199] T 2a7b98025dbf45a0881271da78fe29c0 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/wal/wals/2a7b98025dbf45a0881271da78fe29c0
I20260808 20:00:09.808422 23409 ts_tablet_manager.cc:1950] T 2a7b98025dbf45a0881271da78fe29c0 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting consensus metadata
I20260808 20:00:09.809973 22268 catalog_manager.cc:5050] TS 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): tablet 2a7b98025dbf45a0881271da78fe29c0 (table default.table_b5f73af0927644749fde95d4e9e1bc95 [id=6ab57419bd7a4e3e97816482d3eab619]) successfully deleted
I20260808 20:00:09.810448 23384 consensus_queue.cc:260] T d1c720d7dc8e4b8184ffc863a22cf9e3 P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:09.815196 23384 ts_tablet_manager.cc:1434] T d1c720d7dc8e4b8184ffc863a22cf9e3 P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260808 20:00:09.818049 23384 tablet_bootstrap.cc:492] T b45729e2ec9e4a77b8be89f9657b0424 P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:09.821101 23384 tablet_bootstrap.cc:654] T b45729e2ec9e4a77b8be89f9657b0424 P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:09.822270 23392 tablet_bootstrap.cc:492] T b45729e2ec9e4a77b8be89f9657b0424 P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:09.822474 23392 ts_tablet_manager.cc:1403] T b45729e2ec9e4a77b8be89f9657b0424 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.078s user 0.004s sys 0.000s
I20260808 20:00:09.823329 23392 raft_consensus.cc:359] T b45729e2ec9e4a77b8be89f9657b0424 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.823580 23392 raft_consensus.cc:385] T b45729e2ec9e4a77b8be89f9657b0424 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:09.823658 23392 raft_consensus.cc:740] T b45729e2ec9e4a77b8be89f9657b0424 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:09.823977 23392 consensus_queue.cc:260] T b45729e2ec9e4a77b8be89f9657b0424 P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.826295 23392 ts_tablet_manager.cc:1434] T b45729e2ec9e4a77b8be89f9657b0424 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260808 20:00:09.826716 23392 tablet_bootstrap.cc:492] T d60be8ef6e8642388691bb0cd3ab2ada P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:09.830781 23392 tablet_bootstrap.cc:654] T d60be8ef6e8642388691bb0cd3ab2ada P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:09.832542 23384 tablet_bootstrap.cc:492] T b45729e2ec9e4a77b8be89f9657b0424 P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:09.832755 23384 ts_tablet_manager.cc:1403] T b45729e2ec9e4a77b8be89f9657b0424 P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260808 20:00:09.833658 23384 raft_consensus.cc:359] T b45729e2ec9e4a77b8be89f9657b0424 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.833905 23384 raft_consensus.cc:385] T b45729e2ec9e4a77b8be89f9657b0424 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:09.833981 23384 raft_consensus.cc:740] T b45729e2ec9e4a77b8be89f9657b0424 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:09.834331 23384 consensus_queue.cc:260] T b45729e2ec9e4a77b8be89f9657b0424 P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.838193 23384 ts_tablet_manager.cc:1434] T b45729e2ec9e4a77b8be89f9657b0424 P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260808 20:00:09.843964 23392 tablet_bootstrap.cc:492] T d60be8ef6e8642388691bb0cd3ab2ada P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:09.844251 23392 ts_tablet_manager.cc:1403] T d60be8ef6e8642388691bb0cd3ab2ada P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.018s user 0.010s sys 0.000s
I20260808 20:00:09.844283 23384 tablet_bootstrap.cc:492] T d60be8ef6e8642388691bb0cd3ab2ada P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:09.845181 23392 raft_consensus.cc:359] T d60be8ef6e8642388691bb0cd3ab2ada P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.845479 23392 raft_consensus.cc:385] T d60be8ef6e8642388691bb0cd3ab2ada P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:09.845638 23392 raft_consensus.cc:740] T d60be8ef6e8642388691bb0cd3ab2ada P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:09.845957 23392 consensus_queue.cc:260] T d60be8ef6e8642388691bb0cd3ab2ada P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.846071 23384 tablet_bootstrap.cc:654] T d60be8ef6e8642388691bb0cd3ab2ada P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:09.847929 23392 ts_tablet_manager.cc:1434] T d60be8ef6e8642388691bb0cd3ab2ada P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 20:00:09.853477 23384 tablet_bootstrap.cc:492] T d60be8ef6e8642388691bb0cd3ab2ada P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:09.853683 23384 ts_tablet_manager.cc:1403] T d60be8ef6e8642388691bb0cd3ab2ada P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.001s
I20260808 20:00:09.854566 23384 raft_consensus.cc:359] T d60be8ef6e8642388691bb0cd3ab2ada P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.854794 23384 raft_consensus.cc:385] T d60be8ef6e8642388691bb0cd3ab2ada P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:09.854882 23384 raft_consensus.cc:740] T d60be8ef6e8642388691bb0cd3ab2ada P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:09.855199 23384 consensus_queue.cc:260] T d60be8ef6e8642388691bb0cd3ab2ada P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.860325 23384 ts_tablet_manager.cc:1434] T d60be8ef6e8642388691bb0cd3ab2ada P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260808 20:00:09.935505 23488 raft_consensus.cc:493] T b45729e2ec9e4a77b8be89f9657b0424 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:09.935791 23488 raft_consensus.cc:515] T b45729e2ec9e4a77b8be89f9657b0424 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.936707 23488 leader_election.cc:290] T b45729e2ec9e4a77b8be89f9657b0424 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:09.938197 23179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b45729e2ec9e4a77b8be89f9657b0424" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9" is_pre_election: true
I20260808 20:00:09.938220 22938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b45729e2ec9e4a77b8be89f9657b0424" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653" is_pre_election: true
I20260808 20:00:09.938472 22938 raft_consensus.cc:2468] T b45729e2ec9e4a77b8be89f9657b0424 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 0.
I20260808 20:00:09.938472 23179 raft_consensus.cc:2468] T b45729e2ec9e4a77b8be89f9657b0424 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 0.
I20260808 20:00:09.939091 22607 leader_election.cc:304] T b45729e2ec9e4a77b8be89f9657b0424 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, 5f6b6c2e318d44a984120a06a09e9af9; no voters:
I20260808 20:00:09.939486 23488 raft_consensus.cc:2804] T b45729e2ec9e4a77b8be89f9657b0424 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:09.939610 23488 raft_consensus.cc:493] T b45729e2ec9e4a77b8be89f9657b0424 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:09.939733 23488 raft_consensus.cc:3060] T b45729e2ec9e4a77b8be89f9657b0424 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:09.942816 23488 raft_consensus.cc:515] T b45729e2ec9e4a77b8be89f9657b0424 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.944335 22938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b45729e2ec9e4a77b8be89f9657b0424" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653"
I20260808 20:00:09.944563 22938 raft_consensus.cc:3060] T b45729e2ec9e4a77b8be89f9657b0424 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:09.947503 22938 raft_consensus.cc:2468] T b45729e2ec9e4a77b8be89f9657b0424 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 1.
I20260808 20:00:09.948192 22604 leader_election.cc:304] T b45729e2ec9e4a77b8be89f9657b0424 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:09.948622 23394 raft_consensus.cc:2804] T b45729e2ec9e4a77b8be89f9657b0424 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:09.948782 23394 raft_consensus.cc:697] T b45729e2ec9e4a77b8be89f9657b0424 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 LEADER]: Becoming Leader. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Running, Role: LEADER
I20260808 20:00:09.949113 23394 consensus_queue.cc:237] T b45729e2ec9e4a77b8be89f9657b0424 P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.953003 23488 leader_election.cc:290] T b45729e2ec9e4a77b8be89f9657b0424 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 election: Requested vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:09.953715 23179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b45729e2ec9e4a77b8be89f9657b0424" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9"
I20260808 20:00:09.953976 23179 raft_consensus.cc:3060] T b45729e2ec9e4a77b8be89f9657b0424 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:09.957221 23179 raft_consensus.cc:2468] T b45729e2ec9e4a77b8be89f9657b0424 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 1.
I20260808 20:00:09.969837 23394 raft_consensus.cc:493] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:09.970155 23394 raft_consensus.cc:515] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.971051 23394 leader_election.cc:290] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:09.972039 23179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d60be8ef6e8642388691bb0cd3ab2ada" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9" is_pre_election: true
I20260808 20:00:09.972127 22278 catalog_manager.cc:3528] renamed table default.table_06f9bc92453b456293c74faba2798d3b [id=53f52501c5e44774a011ce5d23f07528] in HMS: new name default.table_c083bd43fffa4344b41de48e5edd3fd3
I20260808 20:00:09.972350 23179 raft_consensus.cc:2468] T d60be8ef6e8642388691bb0cd3ab2ada P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 0.
I20260808 20:00:09.973275 22938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d60be8ef6e8642388691bb0cd3ab2ada" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653" is_pre_election: true
I20260808 20:00:09.973539 22938 raft_consensus.cc:2468] T d60be8ef6e8642388691bb0cd3ab2ada P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 0.
I20260808 20:00:09.974304 22607 leader_election.cc:304] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, 5f6b6c2e318d44a984120a06a09e9af9; no voters:
I20260808 20:00:09.974978 23394 raft_consensus.cc:2804] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:09.975099 23394 raft_consensus.cc:493] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:09.975237 23394 raft_consensus.cc:3060] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:09.978406 23394 raft_consensus.cc:515] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.979794 22938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d60be8ef6e8642388691bb0cd3ab2ada" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653"
I20260808 20:00:09.980058 22938 raft_consensus.cc:3060] T d60be8ef6e8642388691bb0cd3ab2ada P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:09.983146 22938 raft_consensus.cc:2468] T d60be8ef6e8642388691bb0cd3ab2ada P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 1.
I20260808 20:00:09.983829 22604 leader_election.cc:304] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:09.984289 23488 raft_consensus.cc:2804] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:09.984491 23488 raft_consensus.cc:697] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e [term 1 LEADER]: Becoming Leader. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Running, Role: LEADER
I20260808 20:00:09.984790 23488 consensus_queue.cc:237] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:09.989497 23179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d60be8ef6e8642388691bb0cd3ab2ada" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9"
I20260808 20:00:09.989805 23179 raft_consensus.cc:3060] T d60be8ef6e8642388691bb0cd3ab2ada P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:09.993026 23179 raft_consensus.cc:2468] T d60be8ef6e8642388691bb0cd3ab2ada P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 1.
I20260808 20:00:09.997016 23394 leader_election.cc:290] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 election: Requested vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:10.052884 23441 consensus_queue.cc:1048] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:10.062688 22283 catalog_manager.cc:3528] renamed table default.table_16d9fc25b3274923be16373085586742 [id=87fca666b411494c8486baf1bfa58327] in HMS: new name default.table_1cd24efa52a547cc872dd7ffe4938fb8
I20260808 20:00:10.124843 23441 raft_consensus.cc:493] T d1c720d7dc8e4b8184ffc863a22cf9e3 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:10.126057 23441 raft_consensus.cc:515] T d1c720d7dc8e4b8184ffc863a22cf9e3 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:10.129506 23179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1c720d7dc8e4b8184ffc863a22cf9e3" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9" is_pre_election: true
I20260808 20:00:10.129741 23179 raft_consensus.cc:2468] T d1c720d7dc8e4b8184ffc863a22cf9e3 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 0.
I20260808 20:00:10.142855 22711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1c720d7dc8e4b8184ffc863a22cf9e3" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e" is_pre_election: true
I20260808 20:00:10.143318 22711 raft_consensus.cc:2468] T d1c720d7dc8e4b8184ffc863a22cf9e3 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 0.
I20260808 20:00:10.144412 23516 consensus_queue.cc:1048] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:10.144912 23441 leader_election.cc:290] T d1c720d7dc8e4b8184ffc863a22cf9e3 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:10.146126 22831 leader_election.cc:304] T d1c720d7dc8e4b8184ffc863a22cf9e3 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:10.151283 22284 catalog_manager.cc:3528] renamed table default.table_b5f73af0927644749fde95d4e9e1bc95 [id=6ab57419bd7a4e3e97816482d3eab619] in HMS: new name default.table_46d148afc6d142a0855d47f765b25297
I20260808 20:00:10.156771 23520 raft_consensus.cc:2804] T d1c720d7dc8e4b8184ffc863a22cf9e3 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:10.156930 23520 raft_consensus.cc:493] T d1c720d7dc8e4b8184ffc863a22cf9e3 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:10.157644 23520 raft_consensus.cc:3060] T d1c720d7dc8e4b8184ffc863a22cf9e3 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:10.160718 23520 raft_consensus.cc:515] T d1c720d7dc8e4b8184ffc863a22cf9e3 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:10.162348 22711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1c720d7dc8e4b8184ffc863a22cf9e3" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e"
I20260808 20:00:10.162638 22711 raft_consensus.cc:3060] T d1c720d7dc8e4b8184ffc863a22cf9e3 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:10.172394 22711 raft_consensus.cc:2468] T d1c720d7dc8e4b8184ffc863a22cf9e3 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 1.
I20260808 20:00:10.173333 22831 leader_election.cc:304] T d1c720d7dc8e4b8184ffc863a22cf9e3 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:10.173830 23526 raft_consensus.cc:2804] T d1c720d7dc8e4b8184ffc863a22cf9e3 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:10.174045 23526 raft_consensus.cc:697] T d1c720d7dc8e4b8184ffc863a22cf9e3 P e34d5caee97d44fa945a91ddc6a54653 [term 1 LEADER]: Becoming Leader. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Running, Role: LEADER
I20260808 20:00:10.174418 23526 consensus_queue.cc:237] T d1c720d7dc8e4b8184ffc863a22cf9e3 P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:10.183645 23179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1c720d7dc8e4b8184ffc863a22cf9e3" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9"
I20260808 20:00:10.183988 23179 raft_consensus.cc:3060] T d1c720d7dc8e4b8184ffc863a22cf9e3 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:10.187232 23179 raft_consensus.cc:2468] T d1c720d7dc8e4b8184ffc863a22cf9e3 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 1.
I20260808 20:00:10.187548 23520 leader_election.cc:290] T d1c720d7dc8e4b8184ffc863a22cf9e3 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 election: Requested vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:10.192623 22288 catalog_manager.cc:2200] created HMS catalog entry for table [id=355ea74a32ec4502b6679611e8c8b67e]
I20260808 20:00:10.203850 23532 raft_consensus.cc:493] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 16a59d796024414abf9f82a7593530a6)
I20260808 20:00:10.204308 23532 raft_consensus.cc:515] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:10.220701 22288 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:38088 (request call id 1) took 2001 ms. Trace:
I20260808 20:00:10.220880 22288 rpcz_store.cc:276] 0808 20:00:08.219681 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:08.219768 (+ 87us) service_pool.cc:224] Handling call
0808 20:00:09.411201 (+1191433us) catalog_manager.cc:2127] Acquired catalog manager lock
0808 20:00:09.411853 (+ 652us) catalog_manager.cc:2173] Created new table and tablet info
0808 20:00:10.192561 (+780708us) catalog_manager.cc:2199] Created new table in HMS catalog
0808 20:00:10.220367 (+ 27806us) catalog_manager.cc:2233] Wrote table and tablets to system table
0808 20:00:10.220493 (+ 126us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0808 20:00:10.220643 (+ 150us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0808 20:00:10.203828 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0808 20:00:10.203999 (+ 171us) write_op.cc:432] Acquiring schema lock in shared mode
0808 20:00:10.204007 (+ 8us) write_op.cc:435] Acquired schema lock
0808 20:00:10.204009 (+ 2us) tablet.cc:662] Decoding operations
0808 20:00:10.204123 (+ 114us) write_op.cc:620] Acquiring the partition lock for write op
0808 20:00:10.204139 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0808 20:00:10.204144 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0808 20:00:10.204241 (+ 97us) tablet.cc:701] Row locks acquired
0808 20:00:10.204243 (+ 2us) write_op.cc:260] PREPARE: finished
0808 20:00:10.204300 (+ 57us) write_op.cc:270] Start()
0808 20:00:10.204345 (+ 45us) write_op.cc:276] Timestamp: P: 1786219210204249 usec, L: 0
0808 20:00:10.204349 (+ 4us) op_driver.cc:348] REPLICATION: starting
0808 20:00:10.204644 (+ 295us) log.cc:844] Serialized 432 byte log entry
0808 20:00:10.213822 (+ 9178us) op_driver.cc:464] REPLICATION: finished
0808 20:00:10.217768 (+ 3946us) write_op.cc:301] APPLY: starting
0808 20:00:10.217795 (+ 27us) tablet.cc:1367] starting BulkCheckPresence
0808 20:00:10.217851 (+ 56us) tablet.cc:1370] finished BulkCheckPresence
0808 20:00:10.217894 (+ 43us) tablet.cc:1372] starting ApplyRowOperation cycle
0808 20:00:10.218065 (+ 171us) tablet.cc:1383] finished ApplyRowOperation cycle
0808 20:00:10.218110 (+ 45us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0808 20:00:10.218119 (+ 9us) write_op.cc:312] APPLY: finished
0808 20:00:10.218244 (+ 125us) log.cc:844] Serialized 28 byte log entry
0808 20:00:10.220131 (+ 1887us) write_op.cc:489] Releasing partition, row and schema locks
0808 20:00:10.220243 (+ 112us) write_op.cc:454] Released schema lock
0808 20:00:10.220253 (+ 10us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"Hive Metastore.queue_time_us":739062,"Hive Metastore.run_cpu_time_us":290,"Hive Metastore.run_wall_time_us":41292,"child_traces":[["op",{"apply.queue_time_us":3842,"apply.run_cpu_time_us":788,"apply.run_wall_time_us":2600,"num_ops":2,"prepare.queue_time_us":10393,"raft.queue_time_us":1146,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":322,"replication_time_us":9417,"thread_start_us":15742,"threads_started":3}]]}
I20260808 20:00:10.239173 22301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" candidate_term: 3 candidate_status { last_received { term: 2 index: 35 } } ignore_live_leader: false dest_uuid: "16a59d796024414abf9f82a7593530a6" is_pre_election: true
I20260808 20:00:10.241082 23532 leader_election.cc:290] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441)
I20260808 20:00:10.263232 22678 tablet_service.cc:1511] Processing CreateTablet for tablet 96627957fadb4a0a8d9f69159d48cdf8 (DEFAULT_TABLE table=default.table_4dc166b247ee4cf89cdd926e07b51a51 [id=355ea74a32ec4502b6679611e8c8b67e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:10.263803 22678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96627957fadb4a0a8d9f69159d48cdf8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260808 20:00:10.268635 22380 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
I20260808 20:00:10.269654 22288 catalog_manager.cc:5719] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65). New cstate: current_term: 1 leader_uuid: "257c9c7e0c6c441593eac06beb31fa4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } health_report { overall_health: UNKNOWN } } }
I20260808 20:00:10.272351 23144 tablet_service.cc:1511] Processing CreateTablet for tablet 96627957fadb4a0a8d9f69159d48cdf8 (DEFAULT_TABLE table=default.table_4dc166b247ee4cf89cdd926e07b51a51 [id=355ea74a32ec4502b6679611e8c8b67e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:10.272913 23144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96627957fadb4a0a8d9f69159d48cdf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:10.277160 22906 tablet_service.cc:1511] Processing CreateTablet for tablet 96627957fadb4a0a8d9f69159d48cdf8 (DEFAULT_TABLE table=default.table_4dc166b247ee4cf89cdd926e07b51a51 [id=355ea74a32ec4502b6679611e8c8b67e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:10.277722 22906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96627957fadb4a0a8d9f69159d48cdf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:10.294818 23396 raft_consensus.cc:493] T 4e7bbbf891cd4500a8ec7f3d21905240 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:10.295038 23396 raft_consensus.cc:515] T 4e7bbbf891cd4500a8ec7f3d21905240 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:10.295816 23396 leader_election.cc:290] T 4e7bbbf891cd4500a8ec7f3d21905240 P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:10.297142 22711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7bbbf891cd4500a8ec7f3d21905240" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e" is_pre_election: true
I20260808 20:00:10.297847 22938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7bbbf891cd4500a8ec7f3d21905240" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653" is_pre_election: true
I20260808 20:00:10.298135 22938 raft_consensus.cc:2393] T 4e7bbbf891cd4500a8ec7f3d21905240 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f6b6c2e318d44a984120a06a09e9af9 in current term 1: Already voted for candidate 257c9c7e0c6c441593eac06beb31fa4e in this term.
I20260808 20:00:10.300786 23066 leader_election.cc:304] T 4e7bbbf891cd4500a8ec7f3d21905240 P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f6b6c2e318d44a984120a06a09e9af9; no voters: 257c9c7e0c6c441593eac06beb31fa4e, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:00:10.301126 23384 tablet_bootstrap.cc:492] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:10.301385 23392 tablet_bootstrap.cc:492] T 96627957fadb4a0a8d9f69159d48cdf8 P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:10.303102 23392 tablet_bootstrap.cc:654] T 96627957fadb4a0a8d9f69159d48cdf8 P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:10.303102 23384 tablet_bootstrap.cc:654] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:10.304369 23396 raft_consensus.cc:3060] T 4e7bbbf891cd4500a8ec7f3d21905240 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:10.307771 23396 raft_consensus.cc:2749] T 4e7bbbf891cd4500a8ec7f3d21905240 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 20:00:10.309365 22288 catalog_manager.cc:5719] T d1c720d7dc8e4b8184ffc863a22cf9e3 P e34d5caee97d44fa945a91ddc6a54653 reported cstate change: term changed from 0 to 1, leader changed from <none> to e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66). New cstate: current_term: 1 leader_uuid: "e34d5caee97d44fa945a91ddc6a54653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } health_report { overall_health: HEALTHY } } }
I20260808 20:00:10.319960 23548 tablet_bootstrap.cc:492] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:10.322393 23384 tablet_bootstrap.cc:492] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:10.322760 23384 ts_tablet_manager.cc:1403] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.007s
I20260808 20:00:10.323951 23384 raft_consensus.cc:359] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:10.324312 23384 raft_consensus.cc:385] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:10.324437 23384 raft_consensus.cc:740] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:10.324818 23384 consensus_queue.cc:260] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
W20260808 20:00:10.326551 22380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.36.126:43945, user_credentials={real_user=slave}} blocked reactor thread for 57872.2us
I20260808 20:00:10.327502 23384 ts_tablet_manager.cc:1434] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
W20260808 20:00:10.329085 22380 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
I20260808 20:00:10.329404 22380 leader_election.cc:304] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b91a1a84d6cd4038ac9d3ad2b8cf7979; no voters: 16a59d796024414abf9f82a7593530a6, d2c4576401a74a60855647c956b195fd
I20260808 20:00:10.329865 23532 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260808 20:00:10.333889 23392 tablet_bootstrap.cc:492] T 96627957fadb4a0a8d9f69159d48cdf8 P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:10.334103 23392 ts_tablet_manager.cc:1403] T 96627957fadb4a0a8d9f69159d48cdf8 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.033s user 0.006s sys 0.003s
I20260808 20:00:10.334956 23392 raft_consensus.cc:359] T 96627957fadb4a0a8d9f69159d48cdf8 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:10.334906 22288 catalog_manager.cc:5719] T 78ab65d40a004ef9888b6577716b783c P 257c9c7e0c6c441593eac06beb31fa4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65). New cstate: current_term: 1 leader_uuid: "257c9c7e0c6c441593eac06beb31fa4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } health_report { overall_health: HEALTHY } } }
I20260808 20:00:10.335188 23392 raft_consensus.cc:385] T 96627957fadb4a0a8d9f69159d48cdf8 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:10.335261 23392 raft_consensus.cc:740] T 96627957fadb4a0a8d9f69159d48cdf8 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:10.335608 23392 consensus_queue.cc:260] T 96627957fadb4a0a8d9f69159d48cdf8 P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:10.335568 22288 catalog_manager.cc:5719] T b45729e2ec9e4a77b8be89f9657b0424 P 257c9c7e0c6c441593eac06beb31fa4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65). New cstate: current_term: 1 leader_uuid: "257c9c7e0c6c441593eac06beb31fa4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } health_report { overall_health: UNKNOWN } } }
I20260808 20:00:10.336566 23548 tablet_bootstrap.cc:654] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:10.339519 22288 catalog_manager.cc:5719] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65). New cstate: current_term: 1 leader_uuid: "257c9c7e0c6c441593eac06beb31fa4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } health_report { overall_health: UNKNOWN } } }
I20260808 20:00:10.340107 23392 ts_tablet_manager.cc:1434] T 96627957fadb4a0a8d9f69159d48cdf8 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260808 20:00:10.340378 22288 catalog_manager.cc:5719] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65). New cstate: current_term: 1 leader_uuid: "257c9c7e0c6c441593eac06beb31fa4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } health_report { overall_health: UNKNOWN } } }
I20260808 20:00:10.351970 23548 tablet_bootstrap.cc:492] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:10.352169 23548 ts_tablet_manager.cc:1403] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.032s user 0.000s sys 0.004s
I20260808 20:00:10.353084 23548 raft_consensus.cc:359] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:10.353329 23548 raft_consensus.cc:385] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:10.353428 23548 raft_consensus.cc:740] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:10.353758 23548 consensus_queue.cc:260] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:10.354542 23548 ts_tablet_manager.cc:1434] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 20:00:10.360823 22285 catalog_manager.cc:3528] renamed table default.table_6ac9f69790254374990cc94411d04422 [id=43498092c52a457d93f97ba0993e6012] in HMS: new name default.table_4ed5029dcfbd499db24fb72e6b389d42
I20260808 20:00:10.369120 22288 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38088:
name: "default.Table_aa0809b208774982934a9f8de43aecf5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:10.428076 22287 catalog_manager.cc:2200] created HMS catalog entry for table [id=8c917809771f4262811b9f200ff0e925]
I20260808 20:00:10.436508 22287 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:38088 (request call id 21) took 1392 ms. Trace:
I20260808 20:00:10.436698 22287 rpcz_store.cc:276] 0808 20:00:09.043752 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:09.201317 (+157565us) service_pool.cc:224] Handling call
0808 20:00:09.412987 (+211670us) catalog_manager.cc:2127] Acquired catalog manager lock
0808 20:00:09.413440 (+ 453us) catalog_manager.cc:2173] Created new table and tablet info
0808 20:00:10.428021 (+1014581us) catalog_manager.cc:2199] Created new table in HMS catalog
0808 20:00:10.436122 (+ 8101us) catalog_manager.cc:2233] Wrote table and tablets to system table
0808 20:00:10.436282 (+ 160us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0808 20:00:10.436414 (+ 132us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0808 20:00:10.429115 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0808 20:00:10.429254 (+ 139us) write_op.cc:432] Acquiring schema lock in shared mode
0808 20:00:10.429262 (+ 8us) write_op.cc:435] Acquired schema lock
0808 20:00:10.429264 (+ 2us) tablet.cc:662] Decoding operations
0808 20:00:10.429368 (+ 104us) write_op.cc:620] Acquiring the partition lock for write op
0808 20:00:10.429383 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0808 20:00:10.429389 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0808 20:00:10.429481 (+ 92us) tablet.cc:701] Row locks acquired
0808 20:00:10.429484 (+ 3us) write_op.cc:260] PREPARE: finished
0808 20:00:10.429535 (+ 51us) write_op.cc:270] Start()
0808 20:00:10.429573 (+ 38us) write_op.cc:276] Timestamp: P: 1786219210429499 usec, L: 0
0808 20:00:10.429577 (+ 4us) op_driver.cc:348] REPLICATION: starting
0808 20:00:10.429805 (+ 228us) log.cc:844] Serialized 432 byte log entry
0808 20:00:10.435126 (+ 5321us) op_driver.cc:464] REPLICATION: finished
0808 20:00:10.435284 (+ 158us) write_op.cc:301] APPLY: starting
0808 20:00:10.435305 (+ 21us) tablet.cc:1367] starting BulkCheckPresence
0808 20:00:10.435363 (+ 58us) tablet.cc:1370] finished BulkCheckPresence
0808 20:00:10.435397 (+ 34us) tablet.cc:1372] starting ApplyRowOperation cycle
0808 20:00:10.435644 (+ 247us) tablet.cc:1383] finished ApplyRowOperation cycle
0808 20:00:10.435716 (+ 72us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0808 20:00:10.435730 (+ 14us) write_op.cc:312] APPLY: finished
0808 20:00:10.435865 (+ 135us) log.cc:844] Serialized 28 byte log entry
0808 20:00:10.435959 (+ 94us) write_op.cc:489] Releasing partition, row and schema locks
0808 20:00:10.435990 (+ 31us) write_op.cc:454] Released schema lock
0808 20:00:10.435999 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0808 20:00:10.436099 (+ 100us) write_op.cc:489] Releasing partition, row and schema locks
0808 20:00:10.436221 (+ 122us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":947230,"Hive Metastore.run_cpu_time_us":340,"Hive Metastore.run_wall_time_us":67131,"child_traces":[["op",{"apply.queue_time_us":99,"apply.run_cpu_time_us":801,"apply.run_wall_time_us":800,"num_ops":2,"prepare.queue_time_us":147,"prepare.run_cpu_time_us":843,"prepare.run_wall_time_us":844,"raft.queue_time_us":1469,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":375,"replication_time_us":5493}]]}
I20260808 20:00:10.437902 22287 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38088:
name: "default.Table_5730907850e643b4ac068a85e1574ddf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:10.438395 23526 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:10.438599 23526 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:10.439393 23526 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:10.440845 22711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96627957fadb4a0a8d9f69159d48cdf8" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e" is_pre_election: true
I20260808 20:00:10.440830 23179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96627957fadb4a0a8d9f69159d48cdf8" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9" is_pre_election: true
I20260808 20:00:10.441123 22711 raft_consensus.cc:2468] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 0.
I20260808 20:00:10.441124 23179 raft_consensus.cc:2468] T 96627957fadb4a0a8d9f69159d48cdf8 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 0.
I20260808 20:00:10.441641 22835 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:10.442504 23526 raft_consensus.cc:2804] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:10.442610 23526 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:10.442720 23526 raft_consensus.cc:3060] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:10.445905 23526 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:10.447436 22678 tablet_service.cc:1511] Processing CreateTablet for tablet 55cf64ca16df4afbae5f58843f613f27 (DEFAULT_TABLE table=default.table_530ab728450b4272b3e9573534afe4e6 [id=8c917809771f4262811b9f200ff0e925]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:10.447997 22711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96627957fadb4a0a8d9f69159d48cdf8" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e"
I20260808 20:00:10.448030 23144 tablet_service.cc:1511] Processing CreateTablet for tablet 55cf64ca16df4afbae5f58843f613f27 (DEFAULT_TABLE table=default.table_530ab728450b4272b3e9573534afe4e6 [id=8c917809771f4262811b9f200ff0e925]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:10.448276 22711 raft_consensus.cc:3060] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:10.448339 22906 tablet_service.cc:1511] Processing CreateTablet for tablet 55cf64ca16df4afbae5f58843f613f27 (DEFAULT_TABLE table=default.table_530ab728450b4272b3e9573534afe4e6 [id=8c917809771f4262811b9f200ff0e925]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:10.448541 23144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55cf64ca16df4afbae5f58843f613f27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:10.448745 22906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55cf64ca16df4afbae5f58843f613f27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:10.447997 22678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55cf64ca16df4afbae5f58843f613f27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:10.455744 23384 tablet_bootstrap.cc:492] T 55cf64ca16df4afbae5f58843f613f27 P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:10.457114 23392 tablet_bootstrap.cc:492] T 55cf64ca16df4afbae5f58843f613f27 P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:10.457644 23384 tablet_bootstrap.cc:654] T 55cf64ca16df4afbae5f58843f613f27 P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:10.458796 22711 raft_consensus.cc:2468] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 1.
I20260808 20:00:10.459070 23392 tablet_bootstrap.cc:654] T 55cf64ca16df4afbae5f58843f613f27 P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:10.459604 22831 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:10.459973 23520 raft_consensus.cc:2804] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:10.460278 23520 raft_consensus.cc:697] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653 [term 1 LEADER]: Becoming Leader. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Running, Role: LEADER
I20260808 20:00:10.460623 23520 consensus_queue.cc:237] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:10.471650 23179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96627957fadb4a0a8d9f69159d48cdf8" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9"
I20260808 20:00:10.472119 23384 tablet_bootstrap.cc:492] T 55cf64ca16df4afbae5f58843f613f27 P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:10.472218 23179 raft_consensus.cc:3060] T 96627957fadb4a0a8d9f69159d48cdf8 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:10.472321 23384 ts_tablet_manager.cc:1403] T 55cf64ca16df4afbae5f58843f613f27 P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.002s
I20260808 20:00:10.473322 23384 raft_consensus.cc:359] T 55cf64ca16df4afbae5f58843f613f27 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:10.473531 23384 raft_consensus.cc:385] T 55cf64ca16df4afbae5f58843f613f27 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:10.473614 23384 raft_consensus.cc:740] T 55cf64ca16df4afbae5f58843f613f27 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:10.473903 23384 consensus_queue.cc:260] T 55cf64ca16df4afbae5f58843f613f27 P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:10.474512 23384 ts_tablet_manager.cc:1434] T 55cf64ca16df4afbae5f58843f613f27 P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260808 20:00:10.475315 23179 raft_consensus.cc:2468] T 96627957fadb4a0a8d9f69159d48cdf8 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 1.
I20260808 20:00:10.477810 23526 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 election: Requested vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:10.478631 23392 tablet_bootstrap.cc:492] T 55cf64ca16df4afbae5f58843f613f27 P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:10.478817 23392 ts_tablet_manager.cc:1403] T 55cf64ca16df4afbae5f58843f613f27 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.006s
I20260808 20:00:10.479887 23392 raft_consensus.cc:359] T 55cf64ca16df4afbae5f58843f613f27 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:10.480130 23392 raft_consensus.cc:385] T 55cf64ca16df4afbae5f58843f613f27 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:10.480233 23392 raft_consensus.cc:740] T 55cf64ca16df4afbae5f58843f613f27 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:10.480530 23392 consensus_queue.cc:260] T 55cf64ca16df4afbae5f58843f613f27 P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:10.481115 23392 ts_tablet_manager.cc:1434] T 55cf64ca16df4afbae5f58843f613f27 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260808 20:00:10.491104 23179 raft_consensus.cc:3060] T 78ab65d40a004ef9888b6577716b783c P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:10.495643 23394 consensus_queue.cc:1048] T 78ab65d40a004ef9888b6577716b783c P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:10.497489 23548 tablet_bootstrap.cc:492] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:10.499552 23548 tablet_bootstrap.cc:654] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:10.540373 23548 tablet_bootstrap.cc:492] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:10.544234 23548 ts_tablet_manager.cc:1403] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.047s user 0.008s sys 0.004s
I20260808 20:00:10.552392 23548 raft_consensus.cc:359] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:10.553067 23548 raft_consensus.cc:385] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:10.556272 23548 raft_consensus.cc:740] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:10.550906 23564 consensus_queue.cc:1048] T 78ab65d40a004ef9888b6577716b783c P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:10.568560 23548 consensus_queue.cc:260] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:10.569834 23548 ts_tablet_manager.cc:1434] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.018s user 0.000s sys 0.002s
W20260808 20:00:10.594265 23482 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 20:00:10.594902 23482 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 20:00:10.595103 23482 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260808 20:00:10.608531 23482 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 20:00:10.608780 23482 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260808 20:00:10.608932 23482 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
I20260808 20:00:10.609325 22275 catalog_manager.cc:3528] renamed table default.table_b91802b5296a416490e52b3cb07d0519 [id=99b11a3c5ca3411b8c1800c70f61597a] in HMS: new name default.table_583f1fdac11148488799008b032f7ef2
W20260808 20:00:10.609503 23482 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260808 20:00:10.616870 23564 consensus_queue.cc:1048] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:10.622403 23564 consensus_queue.cc:1048] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:10.625976 23482 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.36.84:34883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:44789
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.36.126:43945
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.36.126
--webserver_port=37243
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 08 Aug 2026 19:43:23 UTC on bdcb31816ec0
build id 13246
ASAN enabled
I20260808 20:00:10.628525 23482 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 20:00:10.631309 23482 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 20:00:10.681309 23577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 20:00:10.691797 22268 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20260808 20:00:10.693248 22268 consensus_peers.cc:597] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 -> Peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Couldn't send request to peer d2c4576401a74a60855647c956b195fd. Status: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260808 20:00:10.694199 23579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 20:00:10.696518 23581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 20:00:10.700114 23482 server_base.cc:1061] running on GCE node
I20260808 20:00:10.701558 23482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 20:00:10.703965 22277 catalog_manager.cc:2200] created HMS catalog entry for table [id=1042ec7801c740c09255102bf01b8fd2]
I20260808 20:00:10.706990 23482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 20:00:10.709311 23482 hybrid_clock.cc:648] HybridClock initialized: now 1786219210709257 us; error 39 us; skew 500 ppm
I20260808 20:00:10.709861 23482 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 20:00:10.712497 22277 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:38088 (request call id 19) took 1746 ms. Trace:
I20260808 20:00:10.712649 22277 rpcz_store.cc:276] 0808 20:00:08.966045 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:09.073760 (+107715us) service_pool.cc:224] Handling call
0808 20:00:09.411922 (+338162us) catalog_manager.cc:2127] Acquired catalog manager lock
0808 20:00:09.420043 (+ 8121us) catalog_manager.cc:2173] Created new table and tablet info
0808 20:00:10.703929 (+1283886us) catalog_manager.cc:2199] Created new table in HMS catalog
0808 20:00:10.712143 (+ 8214us) catalog_manager.cc:2233] Wrote table and tablets to system table
0808 20:00:10.712281 (+ 138us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0808 20:00:10.712417 (+ 136us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0808 20:00:10.704808 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0808 20:00:10.704941 (+ 133us) write_op.cc:432] Acquiring schema lock in shared mode
0808 20:00:10.704949 (+ 8us) write_op.cc:435] Acquired schema lock
0808 20:00:10.704952 (+ 3us) tablet.cc:662] Decoding operations
0808 20:00:10.705084 (+ 132us) write_op.cc:620] Acquiring the partition lock for write op
0808 20:00:10.705100 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0808 20:00:10.705105 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0808 20:00:10.705224 (+ 119us) tablet.cc:701] Row locks acquired
0808 20:00:10.705226 (+ 2us) write_op.cc:260] PREPARE: finished
0808 20:00:10.705278 (+ 52us) write_op.cc:270] Start()
0808 20:00:10.705319 (+ 41us) write_op.cc:276] Timestamp: P: 1786219210705222 usec, L: 0
0808 20:00:10.705323 (+ 4us) op_driver.cc:348] REPLICATION: starting
0808 20:00:10.705549 (+ 226us) log.cc:844] Serialized 432 byte log entry
0808 20:00:10.711207 (+ 5658us) op_driver.cc:464] REPLICATION: finished
0808 20:00:10.711383 (+ 176us) write_op.cc:301] APPLY: starting
0808 20:00:10.711405 (+ 22us) tablet.cc:1367] starting BulkCheckPresence
0808 20:00:10.711483 (+ 78us) tablet.cc:1370] finished BulkCheckPresence
0808 20:00:10.711513 (+ 30us) tablet.cc:1372] starting ApplyRowOperation cycle
0808 20:00:10.711636 (+ 123us) tablet.cc:1383] finished ApplyRowOperation cycle
0808 20:00:10.711676 (+ 40us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0808 20:00:10.711683 (+ 7us) write_op.cc:312] APPLY: finished
0808 20:00:10.711798 (+ 115us) log.cc:844] Serialized 28 byte log entry
0808 20:00:10.711880 (+ 82us) write_op.cc:489] Releasing partition, row and schema locks
0808 20:00:10.711908 (+ 28us) write_op.cc:454] Released schema lock
0808 20:00:10.711915 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0808 20:00:10.712001 (+ 86us) write_op.cc:489] Releasing partition, row and schema locks
0808 20:00:10.712005 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1189054,"Hive Metastore.run_cpu_time_us":340,"Hive Metastore.run_wall_time_us":94336,"child_traces":[["op",{"apply.queue_time_us":113,"apply.run_cpu_time_us":610,"apply.run_wall_time_us":609,"num_ops":2,"prepare.queue_time_us":78,"prepare.run_cpu_time_us":864,"prepare.run_wall_time_us":864,"raft.queue_time_us":1279,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":314,"replication_time_us":5845}]]}
I20260808 20:00:10.714787 23394 raft_consensus.cc:493] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:10.714983 23394 raft_consensus.cc:515] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:10.715833 23394 leader_election.cc:290] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:10.717190 22938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cf64ca16df4afbae5f58843f613f27" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653" is_pre_election: true
I20260808 20:00:10.717450 22938 raft_consensus.cc:2468] T 55cf64ca16df4afbae5f58843f613f27 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 0.
I20260808 20:00:10.717895 23176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cf64ca16df4afbae5f58843f613f27" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9" is_pre_election: true
I20260808 20:00:10.718135 23176 raft_consensus.cc:2468] T 55cf64ca16df4afbae5f58843f613f27 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 0.
I20260808 20:00:10.718878 22607 leader_election.cc:304] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, 5f6b6c2e318d44a984120a06a09e9af9; no voters:
I20260808 20:00:10.719475 23564 raft_consensus.cc:2804] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:10.719617 23564 raft_consensus.cc:493] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:10.719722 23564 raft_consensus.cc:3060] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:10.722406 23561 consensus_queue.cc:1048] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:10.722664 23564 raft_consensus.cc:515] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:10.723337 23564 leader_election.cc:290] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 election: Requested vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:10.724128 23176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cf64ca16df4afbae5f58843f613f27" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9"
I20260808 20:00:10.724385 23176 raft_consensus.cc:3060] T 55cf64ca16df4afbae5f58843f613f27 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:10.727231 23176 raft_consensus.cc:2468] T 55cf64ca16df4afbae5f58843f613f27 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 1.
I20260808 20:00:10.727978 22941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55cf64ca16df4afbae5f58843f613f27" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653"
I20260808 20:00:10.728228 22941 raft_consensus.cc:3060] T 55cf64ca16df4afbae5f58843f613f27 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:10.731329 22906 tablet_service.cc:1511] Processing CreateTablet for tablet e18581438df6444e98c94b958a31650c (DEFAULT_TABLE table=default.table_3ffa098d41af4ebb987cec463feb8e76 [id=1042ec7801c740c09255102bf01b8fd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:10.731853 22906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e18581438df6444e98c94b958a31650c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:10.734894 22941 raft_consensus.cc:2468] T 55cf64ca16df4afbae5f58843f613f27 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 1.
I20260808 20:00:10.735483 22678 tablet_service.cc:1511] Processing CreateTablet for tablet e18581438df6444e98c94b958a31650c (DEFAULT_TABLE table=default.table_3ffa098d41af4ebb987cec463feb8e76 [id=1042ec7801c740c09255102bf01b8fd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:10.735989 22678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e18581438df6444e98c94b958a31650c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:10.737061 22277 catalog_manager.cc:5719] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653 reported cstate change: term changed from 0 to 1, leader changed from <none> to e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66). New cstate: current_term: 1 leader_uuid: "e34d5caee97d44fa945a91ddc6a54653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } health_report { overall_health: HEALTHY } } }
I20260808 20:00:10.733938 23144 tablet_service.cc:1511] Processing CreateTablet for tablet e18581438df6444e98c94b958a31650c (DEFAULT_TABLE table=default.table_3ffa098d41af4ebb987cec463feb8e76 [id=1042ec7801c740c09255102bf01b8fd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:10.748768 22604 leader_election.cc:304] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:10.749010 23144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e18581438df6444e98c94b958a31650c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:10.749325 23394 raft_consensus.cc:2804] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:10.749514 23394 raft_consensus.cc:697] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 LEADER]: Becoming Leader. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Running, Role: LEADER
I20260808 20:00:10.749812 23394 consensus_queue.cc:237] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:10.759855 23564 consensus_queue.cc:1048] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:10.763701 22277 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38088:
table { table_name: "default.Table_752d0310c94b42d3902fffa1070bb1d4" } modify_external_catalogs: true
I20260808 20:00:10.764004 22277 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38088:
table { table_name: "default.Table_752d0310c94b42d3902fffa1070bb1d4" } modify_external_catalogs: true
I20260808 20:00:10.786069 23384 tablet_bootstrap.cc:492] T e18581438df6444e98c94b958a31650c P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:10.788074 23384 tablet_bootstrap.cc:654] T e18581438df6444e98c94b958a31650c P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:10.788329 23548 tablet_bootstrap.cc:492] T e18581438df6444e98c94b958a31650c P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:10.790131 23548 tablet_bootstrap.cc:654] T e18581438df6444e98c94b958a31650c P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:10.796885 23566 consensus_queue.cc:1048] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:10.797982 23392 tablet_bootstrap.cc:492] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:10.799929 23392 tablet_bootstrap.cc:654] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:10.817911 23548 tablet_bootstrap.cc:492] T e18581438df6444e98c94b958a31650c P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:10.822597 23548 ts_tablet_manager.cc:1403] T e18581438df6444e98c94b958a31650c P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.034s user 0.008s sys 0.005s
I20260808 20:00:10.822237 23564 consensus_queue.cc:1048] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:10.824244 23384 tablet_bootstrap.cc:492] T e18581438df6444e98c94b958a31650c P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:10.824460 23384 ts_tablet_manager.cc:1403] T e18581438df6444e98c94b958a31650c P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.038s user 0.007s sys 0.000s
I20260808 20:00:10.825331 23384 raft_consensus.cc:359] T e18581438df6444e98c94b958a31650c P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:10.825551 23384 raft_consensus.cc:385] T e18581438df6444e98c94b958a31650c P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:10.825632 23384 raft_consensus.cc:740] T e18581438df6444e98c94b958a31650c P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:10.825934 23384 consensus_queue.cc:260] T e18581438df6444e98c94b958a31650c P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:10.826471 23384 ts_tablet_manager.cc:1434] T e18581438df6444e98c94b958a31650c P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 20:00:10.831974 23392 tablet_bootstrap.cc:492] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:10.832194 23392 ts_tablet_manager.cc:1403] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.034s user 0.006s sys 0.009s
I20260808 20:00:10.833094 23392 raft_consensus.cc:359] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:10.833344 23392 raft_consensus.cc:385] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:10.833420 23392 raft_consensus.cc:740] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:10.833777 23392 consensus_queue.cc:260] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:10.834482 23392 ts_tablet_manager.cc:1434] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 20:00:10.846207 23548 raft_consensus.cc:359] T e18581438df6444e98c94b958a31650c P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:10.846413 23548 raft_consensus.cc:385] T e18581438df6444e98c94b958a31650c P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:10.846516 23548 raft_consensus.cc:740] T e18581438df6444e98c94b958a31650c P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:10.846791 23548 consensus_queue.cc:260] T e18581438df6444e98c94b958a31650c P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:10.849115 23548 ts_tablet_manager.cc:1434] T e18581438df6444e98c94b958a31650c P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260808 20:00:10.852627 23482 webserver.cc:533] Webserver started at http://127.21.36.126:37243/ using document root <none> and password file <none>
I20260808 20:00:10.853940 23482 fs_manager.cc:362] Metadata directory not provided
I20260808 20:00:10.854161 23482 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 20:00:10.859375 22282 catalog_manager.cc:2200] created HMS catalog entry for table [id=524bfe483c7f4c4d99d2757ff290c5eb]
I20260808 20:00:10.866552 22282 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:38088 (request call id 23) took 1743 ms. Trace:
I20260808 20:00:10.866729 22282 rpcz_store.cc:276] 0808 20:00:09.122686 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:09.397962 (+275276us) service_pool.cc:224] Handling call
0808 20:00:09.478827 (+ 80865us) catalog_manager.cc:2127] Acquired catalog manager lock
0808 20:00:09.479372 (+ 545us) catalog_manager.cc:2173] Created new table and tablet info
0808 20:00:10.859312 (+1379940us) catalog_manager.cc:2199] Created new table in HMS catalog
0808 20:00:10.866258 (+ 6946us) catalog_manager.cc:2233] Wrote table and tablets to system table
0808 20:00:10.866371 (+ 113us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0808 20:00:10.866494 (+ 123us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0808 20:00:10.860225 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0808 20:00:10.860368 (+ 143us) write_op.cc:432] Acquiring schema lock in shared mode
0808 20:00:10.860377 (+ 9us) write_op.cc:435] Acquired schema lock
0808 20:00:10.860379 (+ 2us) tablet.cc:662] Decoding operations
0808 20:00:10.860478 (+ 99us) write_op.cc:620] Acquiring the partition lock for write op
0808 20:00:10.860493 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0808 20:00:10.860498 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0808 20:00:10.860588 (+ 90us) tablet.cc:701] Row locks acquired
0808 20:00:10.860590 (+ 2us) write_op.cc:260] PREPARE: finished
0808 20:00:10.860636 (+ 46us) write_op.cc:270] Start()
0808 20:00:10.860675 (+ 39us) write_op.cc:276] Timestamp: P: 1786219210860571 usec, L: 0
0808 20:00:10.860679 (+ 4us) op_driver.cc:348] REPLICATION: starting
0808 20:00:10.860899 (+ 220us) log.cc:844] Serialized 432 byte log entry
0808 20:00:10.865434 (+ 4535us) op_driver.cc:464] REPLICATION: finished
0808 20:00:10.865591 (+ 157us) write_op.cc:301] APPLY: starting
0808 20:00:10.865612 (+ 21us) tablet.cc:1367] starting BulkCheckPresence
0808 20:00:10.865675 (+ 63us) tablet.cc:1370] finished BulkCheckPresence
0808 20:00:10.865707 (+ 32us) tablet.cc:1372] starting ApplyRowOperation cycle
0808 20:00:10.865835 (+ 128us) tablet.cc:1383] finished ApplyRowOperation cycle
0808 20:00:10.865878 (+ 43us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0808 20:00:10.865885 (+ 7us) write_op.cc:312] APPLY: finished
0808 20:00:10.866004 (+ 119us) log.cc:844] Serialized 28 byte log entry
0808 20:00:10.866074 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0808 20:00:10.866096 (+ 22us) write_op.cc:454] Released schema lock
0808 20:00:10.866103 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0808 20:00:10.866180 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0808 20:00:10.866184 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1224125,"Hive Metastore.run_cpu_time_us":301,"Hive Metastore.run_wall_time_us":155406,"child_traces":[["op",{"apply.queue_time_us":98,"apply.run_cpu_time_us":580,"apply.run_wall_time_us":580,"num_ops":2,"prepare.queue_time_us":67,"prepare.run_cpu_time_us":813,"prepare.run_wall_time_us":815,"raft.queue_time_us":1353,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":318,"replication_time_us":4715}]]}
I20260808 20:00:10.869073 23482 fs_manager.cc:714] Time spent opening directory manager: real 0.012s user 0.005s sys 0.005s
I20260808 20:00:10.877790 22678 tablet_service.cc:1511] Processing CreateTablet for tablet 286e98ffe9b44ada92fd8e9776578df2 (DEFAULT_TABLE table=default.table_732a1b16caff489aa844bba46e6ec1cb [id=524bfe483c7f4c4d99d2757ff290c5eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:10.878039 22282 catalog_manager.cc:5719] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65). New cstate: current_term: 1 leader_uuid: "257c9c7e0c6c441593eac06beb31fa4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } health_report { overall_health: UNKNOWN } } }
I20260808 20:00:10.878353 22678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 286e98ffe9b44ada92fd8e9776578df2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:10.883603 23548 tablet_bootstrap.cc:492] T 286e98ffe9b44ada92fd8e9776578df2 P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:10.884197 23144 tablet_service.cc:1511] Processing CreateTablet for tablet 286e98ffe9b44ada92fd8e9776578df2 (DEFAULT_TABLE table=default.table_732a1b16caff489aa844bba46e6ec1cb [id=524bfe483c7f4c4d99d2757ff290c5eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:10.884722 23144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 286e98ffe9b44ada92fd8e9776578df2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:10.885272 23609 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 20:00:10.886539 23548 tablet_bootstrap.cc:654] T 286e98ffe9b44ada92fd8e9776578df2 P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:10.887635 23482 fs_manager.cc:730] Time spent opening block manager: real 0.016s user 0.008s sys 0.007s
I20260808 20:00:10.888185 22906 tablet_service.cc:1511] Processing CreateTablet for tablet 286e98ffe9b44ada92fd8e9776578df2 (DEFAULT_TABLE table=default.table_732a1b16caff489aa844bba46e6ec1cb [id=524bfe483c7f4c4d99d2757ff290c5eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:10.888226 22346 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:00:10.888386 22346 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:00:10.888659 22906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 286e98ffe9b44ada92fd8e9776578df2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:10.887850 23482 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data,/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/wal
uuid: "d2c4576401a74a60855647c956b195fd"
format_stamp: "Formatted at 2026-08-08 20:00:04 on dist-test-slave-pww0"
I20260808 20:00:10.888972 23482 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 20:00:10.892531 23396 raft_consensus.cc:493] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:10.892711 23396 raft_consensus.cc:515] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:10.893482 23396 leader_election.cc:290] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:10.894655 22711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18581438df6444e98c94b958a31650c" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e" is_pre_election: true
I20260808 20:00:10.894894 22711 raft_consensus.cc:2468] T e18581438df6444e98c94b958a31650c P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 0.
I20260808 20:00:10.895313 22938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18581438df6444e98c94b958a31650c" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653" is_pre_election: true
I20260808 20:00:10.902410 22938 raft_consensus.cc:2468] T e18581438df6444e98c94b958a31650c P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 0.
I20260808 20:00:10.909132 23066 leader_election.cc:304] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:10.911593 23396 raft_consensus.cc:2804] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:10.911769 23396 raft_consensus.cc:493] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:10.911863 23396 raft_consensus.cc:3060] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:10.916224 23392 tablet_bootstrap.cc:492] T 286e98ffe9b44ada92fd8e9776578df2 P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:10.918136 23392 tablet_bootstrap.cc:654] T 286e98ffe9b44ada92fd8e9776578df2 P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:10.919646 23566 consensus_queue.cc:1048] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:10.921530 23396 raft_consensus.cc:515] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:10.922859 22710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18581438df6444e98c94b958a31650c" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e"
I20260808 20:00:10.923195 22710 raft_consensus.cc:3060] T e18581438df6444e98c94b958a31650c P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:10.925983 22938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18581438df6444e98c94b958a31650c" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653"
I20260808 20:00:10.926226 22938 raft_consensus.cc:3060] T e18581438df6444e98c94b958a31650c P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:10.926848 22710 raft_consensus.cc:2468] T e18581438df6444e98c94b958a31650c P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 1.
I20260808 20:00:10.927484 23566 consensus_queue.cc:1048] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:10.929075 23066 leader_election.cc:304] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, 5f6b6c2e318d44a984120a06a09e9af9; no voters:
I20260808 20:00:10.929432 22938 raft_consensus.cc:2468] T e18581438df6444e98c94b958a31650c P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 1.
I20260808 20:00:10.938135 23384 tablet_bootstrap.cc:492] T 286e98ffe9b44ada92fd8e9776578df2 P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:10.940069 23384 tablet_bootstrap.cc:654] T 286e98ffe9b44ada92fd8e9776578df2 P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:10.949922 23396 leader_election.cc:290] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 election: Requested vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:10.950877 23396 raft_consensus.cc:2804] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:10.951045 23396 raft_consensus.cc:697] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 LEADER]: Becoming Leader. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Running, Role: LEADER
I20260808 20:00:10.951925 23396 consensus_queue.cc:237] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:10.962962 23548 tablet_bootstrap.cc:492] T 286e98ffe9b44ada92fd8e9776578df2 P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:10.963229 23548 ts_tablet_manager.cc:1403] T 286e98ffe9b44ada92fd8e9776578df2 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.080s user 0.010s sys 0.027s
I20260808 20:00:10.964370 23548 raft_consensus.cc:359] T 286e98ffe9b44ada92fd8e9776578df2 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:10.964664 23548 raft_consensus.cc:385] T 286e98ffe9b44ada92fd8e9776578df2 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:10.964759 23548 raft_consensus.cc:740] T 286e98ffe9b44ada92fd8e9776578df2 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:10.968958 23548 consensus_queue.cc:260] T 286e98ffe9b44ada92fd8e9776578df2 P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:10.973399 23516 consensus_queue.cc:1048] T d1c720d7dc8e4b8184ffc863a22cf9e3 P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:10.997480 23617 tablet.cc:1724] T ab9fb2ba3d5c490a992e704eb4582c82 P 257c9c7e0c6c441593eac06beb31fa4e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 20:00:11.000023 23618 tablet.cc:1724] T ab9fb2ba3d5c490a992e704eb4582c82 P 5f6b6c2e318d44a984120a06a09e9af9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 20:00:11.001839 23548 ts_tablet_manager.cc:1434] T 286e98ffe9b44ada92fd8e9776578df2 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.038s user 0.003s sys 0.000s
I20260808 20:00:11.012116 23616 tablet.cc:1724] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 20:00:11.017510 23392 tablet_bootstrap.cc:492] T 286e98ffe9b44ada92fd8e9776578df2 P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:11.017725 23392 ts_tablet_manager.cc:1403] T 286e98ffe9b44ada92fd8e9776578df2 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.102s user 0.002s sys 0.026s
I20260808 20:00:11.018744 23392 raft_consensus.cc:359] T 286e98ffe9b44ada92fd8e9776578df2 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:11.018972 23392 raft_consensus.cc:385] T 286e98ffe9b44ada92fd8e9776578df2 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:11.019057 23392 raft_consensus.cc:740] T 286e98ffe9b44ada92fd8e9776578df2 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:11.019326 23392 consensus_queue.cc:260] T 286e98ffe9b44ada92fd8e9776578df2 P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:11.020776 23392 ts_tablet_manager.cc:1434] T 286e98ffe9b44ada92fd8e9776578df2 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 20:00:11.025810 23384 tablet_bootstrap.cc:492] T 286e98ffe9b44ada92fd8e9776578df2 P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:11.026015 23384 ts_tablet_manager.cc:1403] T 286e98ffe9b44ada92fd8e9776578df2 P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.088s user 0.002s sys 0.010s
I20260808 20:00:11.026939 23384 raft_consensus.cc:359] T 286e98ffe9b44ada92fd8e9776578df2 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:11.027546 23384 raft_consensus.cc:385] T 286e98ffe9b44ada92fd8e9776578df2 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:11.027649 23384 raft_consensus.cc:740] T 286e98ffe9b44ada92fd8e9776578df2 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:11.027978 23384 consensus_queue.cc:260] T 286e98ffe9b44ada92fd8e9776578df2 P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
W20260808 20:00:11.030391 23066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.36.65:39923, user_credentials={real_user=slave}} blocked reactor thread for 101350us
I20260808 20:00:11.034519 23384 ts_tablet_manager.cc:1434] T 286e98ffe9b44ada92fd8e9776578df2 P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 20:00:11.049201 23526 consensus_queue.cc:1048] T d1c720d7dc8e4b8184ffc863a22cf9e3 P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:11.051499 22282 catalog_manager.cc:5719] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67). New cstate: current_term: 1 leader_uuid: "5f6b6c2e318d44a984120a06a09e9af9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } health_report { overall_health: HEALTHY } } }
I20260808 20:00:11.052137 22282 catalog_manager.cc:5811] TS 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047) does not have the latest schema for tablet 7117a3852b424a2d83a00b4ebab727cf (table default.table_1cd24efa52a547cc872dd7ffe4938fb8 [id=87fca666b411494c8486baf1bfa58327]). Expected version 1 got 0
I20260808 20:00:11.053678 23564 consensus_queue.cc:1048] T b45729e2ec9e4a77b8be89f9657b0424 P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:11.064080 23617 tablet.cc:1724] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 20:00:11.065178 23482 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 20:00:11.067813 23618 tablet.cc:1724] T 7117a3852b424a2d83a00b4ebab727cf P 5f6b6c2e318d44a984120a06a09e9af9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 20:00:11.070737 23482 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 20:00:11.071727 23482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 20:00:11.076031 22236 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:00:11.076540 22236 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:00:11.089691 23616 tablet.cc:1724] T 7117a3852b424a2d83a00b4ebab727cf P e34d5caee97d44fa945a91ddc6a54653: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 20:00:11.101639 22282 catalog_manager.cc:5811] TS e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229) does not have the latest schema for tablet 7117a3852b424a2d83a00b4ebab727cf (table default.table_1cd24efa52a547cc872dd7ffe4938fb8 [id=87fca666b411494c8486baf1bfa58327]). Expected version 1 got 0
I20260808 20:00:11.108635 23564 consensus_queue.cc:1048] T b45729e2ec9e4a77b8be89f9657b0424 P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:11.118151 23176 raft_consensus.cc:1275] T d60be8ef6e8642388691bb0cd3ab2ada P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Refusing update from remote peer 257c9c7e0c6c441593eac06beb31fa4e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 20:00:11.119221 23564 consensus_queue.cc:1048] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:11.126804 22282 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6: default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528] alter complete (version 1)
I20260808 20:00:11.129799 22282 catalog_manager.cc:5811] TS 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923) does not have the latest schema for tablet 7117a3852b424a2d83a00b4ebab727cf (table default.table_1cd24efa52a547cc872dd7ffe4938fb8 [id=87fca666b411494c8486baf1bfa58327]). Expected version 1 got 0
I20260808 20:00:11.146221 22938 raft_consensus.cc:1275] T d60be8ef6e8642388691bb0cd3ab2ada P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Refusing update from remote peer 257c9c7e0c6c441593eac06beb31fa4e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 20:00:11.146637 22282 catalog_manager.cc:5811] TS 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047) does not have the latest schema for tablet b45729e2ec9e4a77b8be89f9657b0424 (table default.table_4ed5029dcfbd499db24fb72e6b389d42 [id=43498092c52a457d93f97ba0993e6012]). Expected version 1 got 0
I20260808 20:00:11.149662 23617 tablet.cc:1724] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 20:00:11.153954 23653 mvcc.cc:204] Tried to move back new op lower bound from 7316353888593342464 to 7316353884100771840. Current Snapshot: MvccSnapshot[applied={T|T < 7316353888593342464}]
I20260808 20:00:11.159561 23659 tablet.cc:1724] T b45729e2ec9e4a77b8be89f9657b0424 P 257c9c7e0c6c441593eac06beb31fa4e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 20:00:11.160395 23561 consensus_queue.cc:1048] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:11.164994 23618 tablet.cc:1724] T b45729e2ec9e4a77b8be89f9657b0424 P 5f6b6c2e318d44a984120a06a09e9af9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 20:00:11.165346 22282 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6: default.table_1cd24efa52a547cc872dd7ffe4938fb8 [id=87fca666b411494c8486baf1bfa58327] alter complete (version 1)
I20260808 20:00:11.165779 23529 mvcc.cc:204] Tried to move back new op lower bound from 7316353888593342464 to 7316353884100771840. Current Snapshot: MvccSnapshot[applied={T|T < 7316353888593342464}]
I20260808 20:00:11.168411 23616 tablet.cc:1724] T b45729e2ec9e4a77b8be89f9657b0424 P e34d5caee97d44fa945a91ddc6a54653: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 20:00:11.168815 22282 catalog_manager.cc:5811] TS e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229) does not have the latest schema for tablet b45729e2ec9e4a77b8be89f9657b0424 (table default.table_4ed5029dcfbd499db24fb72e6b389d42 [id=43498092c52a457d93f97ba0993e6012]). Expected version 1 got 0
I20260808 20:00:11.170138 22282 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38088:
name: "default.Table_bfc21652528345b883ecf7962d128fee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:11.175309 23618 tablet.cc:1724] T d60be8ef6e8642388691bb0cd3ab2ada P 5f6b6c2e318d44a984120a06a09e9af9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 20:00:11.178990 23617 tablet.cc:1724] T 78ab65d40a004ef9888b6577716b783c P 257c9c7e0c6c441593eac06beb31fa4e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 20:00:11.184764 23616 tablet.cc:1724] T d60be8ef6e8642388691bb0cd3ab2ada P e34d5caee97d44fa945a91ddc6a54653: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 20:00:11.189513 23618 tablet.cc:1724] T 78ab65d40a004ef9888b6577716b783c P 5f6b6c2e318d44a984120a06a09e9af9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 20:00:11.195598 23616 tablet.cc:1724] T 78ab65d40a004ef9888b6577716b783c P e34d5caee97d44fa945a91ddc6a54653: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 20:00:11.353397 23526 consensus_queue.cc:1048] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:11.358872 23622 raft_consensus.cc:493] T 286e98ffe9b44ada92fd8e9776578df2 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:11.359105 23622 raft_consensus.cc:515] T 286e98ffe9b44ada92fd8e9776578df2 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:11.360210 23622 leader_election.cc:290] T 286e98ffe9b44ada92fd8e9776578df2 P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:11.361089 22941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "286e98ffe9b44ada92fd8e9776578df2" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653" is_pre_election: true
I20260808 20:00:11.361353 22941 raft_consensus.cc:2468] T 286e98ffe9b44ada92fd8e9776578df2 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 0.
I20260808 20:00:11.361348 22711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "286e98ffe9b44ada92fd8e9776578df2" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e" is_pre_election: true
I20260808 20:00:11.361559 22711 raft_consensus.cc:2468] T 286e98ffe9b44ada92fd8e9776578df2 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 0.
I20260808 20:00:11.361956 23066 leader_election.cc:304] T 286e98ffe9b44ada92fd8e9776578df2 P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:11.362663 23622 raft_consensus.cc:2804] T 286e98ffe9b44ada92fd8e9776578df2 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:11.362782 23622 raft_consensus.cc:493] T 286e98ffe9b44ada92fd8e9776578df2 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:11.362859 23622 raft_consensus.cc:3060] T 286e98ffe9b44ada92fd8e9776578df2 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:11.366457 23622 raft_consensus.cc:515] T 286e98ffe9b44ada92fd8e9776578df2 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:11.368010 22711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "286e98ffe9b44ada92fd8e9776578df2" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e"
I20260808 20:00:11.368257 22711 raft_consensus.cc:3060] T 286e98ffe9b44ada92fd8e9776578df2 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:11.371877 22711 raft_consensus.cc:2468] T 286e98ffe9b44ada92fd8e9776578df2 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 1.
I20260808 20:00:11.372615 23066 leader_election.cc:304] T 286e98ffe9b44ada92fd8e9776578df2 P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, 5f6b6c2e318d44a984120a06a09e9af9; no voters:
I20260808 20:00:11.373009 23396 raft_consensus.cc:2804] T 286e98ffe9b44ada92fd8e9776578df2 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:11.373195 23396 raft_consensus.cc:697] T 286e98ffe9b44ada92fd8e9776578df2 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 LEADER]: Becoming Leader. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Running, Role: LEADER
I20260808 20:00:11.374130 23396 consensus_queue.cc:237] T 286e98ffe9b44ada92fd8e9776578df2 P 5f6b6c2e318d44a984120a06a09e9af9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:11.374465 22941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "286e98ffe9b44ada92fd8e9776578df2" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653"
I20260808 20:00:11.374677 22941 raft_consensus.cc:3060] T 286e98ffe9b44ada92fd8e9776578df2 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:11.376469 23739 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.36.126:43945 every 8 connection(s)
I20260808 20:00:11.376840 23482 rpc_server.cc:307] RPC server started. Bound to: 127.21.36.126:43945
I20260808 20:00:11.377741 22941 raft_consensus.cc:2468] T 286e98ffe9b44ada92fd8e9776578df2 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 1.
I20260808 20:00:11.378966 23622 leader_election.cc:290] T 286e98ffe9b44ada92fd8e9776578df2 P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 election: Requested vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:11.379204 23482 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data/info.pb
I20260808 20:00:11.389000 21649 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu as pid 23482
I20260808 20:00:11.401369 23520 consensus_queue.cc:1048] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:11.446017 23256 heartbeater.cc:344] Connected to a master server at 127.21.36.126:43945
I20260808 20:00:11.447885 23742 sys_catalog.cc:263] Verifying existing consensus state
I20260808 20:00:11.447968 22794 heartbeater.cc:344] Connected to a master server at 127.21.36.126:43945
I20260808 20:00:11.449872 23017 heartbeater.cc:344] Connected to a master server at 127.21.36.126:43945
I20260808 20:00:11.454798 23742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Bootstrap starting.
I20260808 20:00:11.477669 23742 log.cc:826] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Log is configured to *not* fsync() on all Append() calls
I20260808 20:00:11.501547 23742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 20:00:11.502576 23742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Bootstrap complete.
I20260808 20:00:11.511545 23742 raft_consensus.cc:359] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:11.512669 23742 raft_consensus.cc:740] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2c4576401a74a60855647c956b195fd, State: Initialized, Role: FOLLOWER
I20260808 20:00:11.513684 23742 consensus_queue.cc:260] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:11.517558 23753 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:11.517993 23753 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:11.519091 23742 sys_catalog.cc:565] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 20:00:11.544309 23772 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 20:00:11.625391 23394 consensus_queue.cc:1048] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:11.659423 23677 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" instance_seqno: 1786219208132788) as {username='slave'} at 127.21.36.67:52987; Asking this server to re-register.
I20260808 20:00:11.666788 23256 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:11.668530 23561 consensus_queue.cc:1048] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:11.670305 23676 ts_manager.cc:194] Registered new tserver with Master: 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:11.672420 23677 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" instance_seqno: 1786219207065397) as {username='slave'} at 127.21.36.65:46345; Asking this server to re-register.
I20260808 20:00:11.673578 22794 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:11.674280 23784 raft_consensus.cc:493] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 16a59d796024414abf9f82a7593530a6)
I20260808 20:00:11.674460 23784 raft_consensus.cc:515] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:11.675190 23784 leader_election.cc:290] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441)
I20260808 20:00:11.676705 22301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" candidate_term: 3 candidate_status { last_received { term: 2 index: 57 } } ignore_live_leader: false dest_uuid: "16a59d796024414abf9f82a7593530a6" is_pre_election: true
I20260808 20:00:11.679224 23677 ts_manager.cc:194] Registered new tserver with Master: 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923)
I20260808 20:00:11.686265 23676 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" instance_seqno: 1786219207598982) as {username='slave'} at 127.21.36.66:54523; Asking this server to re-register.
I20260808 20:00:11.686961 23692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" candidate_term: 3 candidate_status { last_received { term: 2 index: 57 } } ignore_live_leader: false dest_uuid: "d2c4576401a74a60855647c956b195fd" is_pre_election: true
I20260808 20:00:11.687732 23692 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b91a1a84d6cd4038ac9d3ad2b8cf7979 in term 2.
I20260808 20:00:11.688390 22380 leader_election.cc:304] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd; no voters: 16a59d796024414abf9f82a7593530a6
I20260808 20:00:11.688786 23784 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260808 20:00:11.688920 23784 raft_consensus.cc:493] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 16a59d796024414abf9f82a7593530a6)
I20260808 20:00:11.689013 23784 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 2 FOLLOWER]: Advancing to term 3
I20260808 20:00:11.690986 23017 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:11.692183 23784 raft_consensus.cc:515] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:11.692885 23784 leader_election.cc:290] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 3 election: Requested vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441)
I20260808 20:00:11.693117 23676 ts_manager.cc:194] Registered new tserver with Master: e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:11.693610 23692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" candidate_term: 3 candidate_status { last_received { term: 2 index: 57 } } ignore_live_leader: false dest_uuid: "d2c4576401a74a60855647c956b195fd"
I20260808 20:00:11.693809 23692 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 2 FOLLOWER]: Advancing to term 3
I20260808 20:00:11.702335 23692 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b91a1a84d6cd4038ac9d3ad2b8cf7979 in term 3.
I20260808 20:00:11.703248 22380 leader_election.cc:304] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd; no voters:
I20260808 20:00:11.703752 23784 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 20:00:11.706434 23784 raft_consensus.cc:697] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 3 LEADER]: Becoming Leader. State: Replica: b91a1a84d6cd4038ac9d3ad2b8cf7979, State: Running, Role: LEADER
I20260808 20:00:11.706790 23784 consensus_queue.cc:237] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 57, Committed index: 57, Last appended: 2.57, Last appended by leader: 57, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:11.708027 23788 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b91a1a84d6cd4038ac9d3ad2b8cf7979. Latest consensus state: current_term: 3 leader_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:11.708374 23788 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: This master's current role is: LEADER
I20260808 20:00:11.716785 22301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" candidate_term: 3 candidate_status { last_received { term: 2 index: 57 } } ignore_live_leader: false dest_uuid: "16a59d796024414abf9f82a7593530a6"
I20260808 20:00:11.726112 23791 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 20:00:11.737350 23692 raft_consensus.cc:1240] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 3 FOLLOWER]: Rejecting Update request from peer 16a59d796024414abf9f82a7593530a6 for earlier term 2. Current term is 3. Ops: [2.5-2.57]
I20260808 20:00:11.739387 23786 consensus_queue.cc:1059] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260808 20:00:11.738842 23791 catalog_manager.cc:679] Loaded metadata for table default.table_324c660111c84a72a6935eb8e30a7ae6 [id=06447c1e53ac4366baae14ef41588d7f]
I20260808 20:00:11.752434 23791 catalog_manager.cc:679] Loaded metadata for table default.table_3ffa098d41af4ebb987cec463feb8e76 [id=1042ec7801c740c09255102bf01b8fd2]
I20260808 20:00:11.753022 23791 catalog_manager.cc:679] Loaded metadata for table default.table_4dc166b247ee4cf89cdd926e07b51a51 [id=355ea74a32ec4502b6679611e8c8b67e]
I20260808 20:00:11.753423 23791 catalog_manager.cc:679] Loaded metadata for table default.table_f4c950a229114bde8c62335c66af32ed [id=373408577a474e4bb9f6ad9aec399098]
I20260808 20:00:11.753796 23791 catalog_manager.cc:679] Loaded metadata for table default.table_752d0310c94b42d3902fffa1070bb1d4 [id=3b10ed2d37fe46a5b63d646901474c8e]
I20260808 20:00:11.754503 23791 catalog_manager.cc:679] Loaded metadata for table default.table_4ed5029dcfbd499db24fb72e6b389d42 [id=43498092c52a457d93f97ba0993e6012]
I20260808 20:00:11.754951 23791 catalog_manager.cc:679] Loaded metadata for table default.table_732a1b16caff489aa844bba46e6ec1cb [id=524bfe483c7f4c4d99d2757ff290c5eb]
I20260808 20:00:11.755367 23791 catalog_manager.cc:679] Loaded metadata for table default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528]
I20260808 20:00:11.755852 23791 catalog_manager.cc:679] Loaded metadata for table default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619]
I20260808 20:00:11.756465 23791 catalog_manager.cc:679] Loaded metadata for table default.table_1cd24efa52a547cc872dd7ffe4938fb8 [id=87fca666b411494c8486baf1bfa58327]
I20260808 20:00:11.756970 23791 catalog_manager.cc:679] Loaded metadata for table default.table_530ab728450b4272b3e9573534afe4e6 [id=8c917809771f4262811b9f200ff0e925]
I20260808 20:00:11.757449 23791 catalog_manager.cc:679] Loaded metadata for table default.table_583f1fdac11148488799008b032f7ef2 [id=99b11a3c5ca3411b8c1800c70f61597a]
I20260808 20:00:11.757897 23791 catalog_manager.cc:679] Loaded metadata for table default.table_831d17f2742e4fb8bc727d56fc9d1c85 [id=b47087e2cd6349b1ba2b8daf55b2d1d5]
I20260808 20:00:11.761524 23791 tablet_loader.cc:96] loaded metadata for tablet 286e98ffe9b44ada92fd8e9776578df2 (table default.table_732a1b16caff489aa844bba46e6ec1cb [id=524bfe483c7f4c4d99d2757ff290c5eb])
I20260808 20:00:11.762358 23791 tablet_loader.cc:96] loaded metadata for tablet 4e7bbbf891cd4500a8ec7f3d21905240 (table default.table_f4c950a229114bde8c62335c66af32ed [id=373408577a474e4bb9f6ad9aec399098])
I20260808 20:00:11.763028 23791 tablet_loader.cc:96] loaded metadata for tablet 55cf64ca16df4afbae5f58843f613f27 (table default.table_530ab728450b4272b3e9573534afe4e6 [id=8c917809771f4262811b9f200ff0e925])
I20260808 20:00:11.763420 23791 tablet_loader.cc:96] loaded metadata for tablet 6ceb53121b5247b7ac83292c4c2d5416 (table default.table_324c660111c84a72a6935eb8e30a7ae6 [id=06447c1e53ac4366baae14ef41588d7f])
I20260808 20:00:11.763862 23791 tablet_loader.cc:96] loaded metadata for tablet 7117a3852b424a2d83a00b4ebab727cf (table default.table_1cd24efa52a547cc872dd7ffe4938fb8 [id=87fca666b411494c8486baf1bfa58327])
I20260808 20:00:11.764232 23791 tablet_loader.cc:96] loaded metadata for tablet 78ab65d40a004ef9888b6577716b783c (table default.table_583f1fdac11148488799008b032f7ef2 [id=99b11a3c5ca3411b8c1800c70f61597a])
I20260808 20:00:11.764859 23791 tablet_loader.cc:96] loaded metadata for tablet 96627957fadb4a0a8d9f69159d48cdf8 (table default.table_4dc166b247ee4cf89cdd926e07b51a51 [id=355ea74a32ec4502b6679611e8c8b67e])
I20260808 20:00:11.765232 23791 tablet_loader.cc:96] loaded metadata for tablet a89c8105460e45f9a77af8c7cf84607c (table default.table_752d0310c94b42d3902fffa1070bb1d4 [id=3b10ed2d37fe46a5b63d646901474c8e])
I20260808 20:00:11.765618 23791 tablet_loader.cc:96] loaded metadata for tablet ab9fb2ba3d5c490a992e704eb4582c82 (table default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528])
I20260808 20:00:11.766045 23791 tablet_loader.cc:96] loaded metadata for tablet b45729e2ec9e4a77b8be89f9657b0424 (table default.table_4ed5029dcfbd499db24fb72e6b389d42 [id=43498092c52a457d93f97ba0993e6012])
I20260808 20:00:11.766431 23791 tablet_loader.cc:96] loaded metadata for tablet d1c720d7dc8e4b8184ffc863a22cf9e3 (table default.table_831d17f2742e4fb8bc727d56fc9d1c85 [id=b47087e2cd6349b1ba2b8daf55b2d1d5])
I20260808 20:00:11.766813 23791 tablet_loader.cc:96] loaded metadata for tablet d60be8ef6e8642388691bb0cd3ab2ada (table default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619])
I20260808 20:00:11.767426 23791 tablet_loader.cc:96] loaded metadata for tablet e18581438df6444e98c94b958a31650c (table default.table_3ffa098d41af4ebb987cec463feb8e76 [id=1042ec7801c740c09255102bf01b8fd2])
I20260808 20:00:11.767819 23791 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 20:00:11.769379 23791 catalog_manager.cc:1295] Loaded cluster ID: 9c4ad126d38943188e9e4422f5e27418
I20260808 20:00:11.769488 23791 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 20:00:11.784192 23396 consensus_queue.cc:1048] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:11.796620 23792 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 2 LEADER]: Stepping down as leader of term 2
I20260808 20:00:11.802062 22409 raft_consensus.cc:1240] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 3 LEADER]: Rejecting Update request from peer 16a59d796024414abf9f82a7593530a6 for earlier term 2. Current term is 3. Ops: []
I20260808 20:00:11.802407 23792 raft_consensus.cc:740] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 16a59d796024414abf9f82a7593530a6, State: Running, Role: LEADER
I20260808 20:00:11.803222 23792 consensus_queue.cc:260] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 57, Committed index: 57, Last appended: 2.57, Last appended by leader: 57, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:11.803872 23792 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 2 FOLLOWER]: Advancing to term 3
I20260808 20:00:11.811993 23621 consensus_queue.cc:1048] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:11.816073 23791 catalog_manager.cc:1540] Loading token signing keys...
I20260808 20:00:11.817678 23791 catalog_manager.cc:6103] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: Loaded TSK: 0
I20260808 20:00:11.823496 23791 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 20:00:11.827037 23791 catalog_manager.cc:1563] Loading latest processed Hive Metastore notification log event ID...
I20260808 20:00:11.829245 23791 catalog_manager.cc:5941] Last processed Hive Metastore notification event ID: 18
I20260808 20:00:11.839368 23016 heartbeater.cc:499] Master 127.21.36.124:34593 was elected leader, sending a full tablet report...
I20260808 20:00:11.851653 22301 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 3 FOLLOWER]: Refusing update from remote peer b91a1a84d6cd4038ac9d3ad2b8cf7979: Log matching property violated. Preceding OpId in replica: term: 2 index: 57. Preceding OpId from leader: term: 3 index: 59. (index mismatch)
I20260808 20:00:11.852358 23692 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 3 FOLLOWER]: Refusing update from remote peer b91a1a84d6cd4038ac9d3ad2b8cf7979: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 59. (index mismatch)
I20260808 20:00:11.853142 23788 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 58, Last known committed idx: 57, Time since last communication: 0.000s
I20260808 20:00:11.853494 23784 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 58, Last known committed idx: 4, Time since last communication: 0.000s
I20260808 20:00:11.867810 23792 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b91a1a84d6cd4038ac9d3ad2b8cf7979. Latest consensus state: current_term: 3 leader_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:11.868108 23792 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:11.878368 23792 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:11.878654 23792 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:11.882339 22398 catalog_manager.cc:6264] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: default.table_583f1fdac11148488799008b032f7ef2 [id=99b11a3c5ca3411b8c1800c70f61597a] alter complete (version 1)
I20260808 20:00:11.882570 23784 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:11.882963 23784 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: This master's current role is: LEADER
I20260808 20:00:11.888664 22398 catalog_manager.cc:6264] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619] alter complete (version 1)
I20260808 20:00:11.895162 22398 catalog_manager.cc:6264] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: default.table_4ed5029dcfbd499db24fb72e6b389d42 [id=43498092c52a457d93f97ba0993e6012] alter complete (version 1)
I20260808 20:00:11.907035 23753 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader b91a1a84d6cd4038ac9d3ad2b8cf7979. Latest consensus state: current_term: 3 leader_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:11.907377 23753 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:11.907928 23802 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:11.908316 23802 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:11.923781 23784 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:11.924101 23784 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: This master's current role is: LEADER
I20260808 20:00:11.927706 23802 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:11.928079 23802 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:11.970803 23798 mvcc.cc:204] Tried to move back new op lower bound from 7316353891735748608 to 7316353875183374336. Current Snapshot: MvccSnapshot[applied={T|T < 7316353891735748608}]
I20260808 20:00:12.018572 22281 catalog_manager.cc:2757] deleted HMS catalog entry for table default.table_f4c950a229114bde8c62335c66af32ed [id=373408577a474e4bb9f6ad9aec399098]
I20260808 20:00:12.022250 22278 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:38088 (request call id 11) took 3262 ms. Trace:
W20260808 20:00:12.022537 22287 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_5730907850e643b4ac068a85e1574ddf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 20:00:12.022419 22278 rpcz_store.cc:276] 0808 20:00:08.760196 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:08.760279 (+ 83us) service_pool.cc:224] Handling call
0808 20:00:09.410764 (+650485us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0808 20:00:12.021564 (+2610800us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0808 20:00:12.021839 (+ 275us) catalog_manager.cc:3751] Apply alter schema
0808 20:00:12.022179 (+ 340us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":55879,"Hive Metastore.run_cpu_time_us":1242,"Hive Metastore.run_wall_time_us":504987}
W20260808 20:00:12.023795 22278 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.21.36.65:36841 (request call id 24) took 849 ms (client timeout 1000 ms). Trace:
W20260808 20:00:12.023926 22278 rpcz_store.cc:269] 0808 20:00:11.174787 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:12.022819 (+848032us) service_pool.cc:224] Handling call
0808 20:00:12.023743 (+ 924us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260808 20:00:12.024142 22275 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:38088 (request call id 22) took 2941 ms. Trace:
I20260808 20:00:12.024310 22275 rpcz_store.cc:276] 0808 20:00:09.082221 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:09.334192 (+251971us) service_pool.cc:224] Handling call
0808 20:00:09.413601 (+ 79409us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0808 20:00:12.023523 (+2609922us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0808 20:00:12.023790 (+ 267us) catalog_manager.cc:3751] Apply alter schema
0808 20:00:12.024076 (+ 286us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":1014237,"Hive Metastore.run_cpu_time_us":763,"Hive Metastore.run_wall_time_us":181209}
W20260808 20:00:12.024992 22278 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.21.36.66:35265 (request call id 19) took 838 ms (client timeout 1000 ms). Trace:
W20260808 20:00:12.025115 22278 rpcz_store.cc:269] 0808 20:00:11.186614 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:12.024178 (+837564us) service_pool.cc:224] Handling call
0808 20:00:12.024951 (+ 773us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260808 20:00:12.025424 22285 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:38088 (request call id 20) took 3041 ms. Trace:
I20260808 20:00:12.026592 22285 rpcz_store.cc:276] 0808 20:00:08.983541 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:09.074886 (+ 91345us) service_pool.cc:224] Handling call
0808 20:00:09.412416 (+337530us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0808 20:00:12.021339 (+2608923us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0808 20:00:12.021781 (+ 442us) catalog_manager.cc:3751] Apply alter schema
0808 20:00:12.025364 (+ 3583us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":779830,"Hive Metastore.run_cpu_time_us":751,"Hive Metastore.run_wall_time_us":168310}
W20260808 20:00:12.028930 22275 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.21.36.67:35067 (request call id 20) took 816 ms (client timeout 1000 ms). Trace:
W20260808 20:00:12.029181 22288 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_aa0809b208774982934a9f8de43aecf5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260808 20:00:12.030424 22282 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_bfc21652528345b883ecf7962d128fee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 20:00:12.030290 22281 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:38088 (request call id 29) took 2841 ms. Trace:
I20260808 20:00:12.031550 22284 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:38088 (request call id 18) took 3109 ms. Trace:
I20260808 20:00:12.031672 22284 rpcz_store.cc:276] 0808 20:00:08.922222 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:08.962950 (+ 40728us) service_pool.cc:224] Handling call
0808 20:00:09.411291 (+448341us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0808 20:00:12.025607 (+2614316us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0808 20:00:12.031039 (+ 5432us) catalog_manager.cc:3751] Apply alter schema
0808 20:00:12.031339 (+ 300us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":651070,"Hive Metastore.run_cpu_time_us":802,"Hive Metastore.run_wall_time_us":88469}
I20260808 20:00:12.032269 22283 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:38088 (request call id 12) took 3187 ms. Trace:
I20260808 20:00:12.035993 22283 rpcz_store.cc:276] 0808 20:00:08.843692 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:08.843759 (+ 67us) service_pool.cc:224] Handling call
0808 20:00:09.411046 (+567287us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0808 20:00:12.025473 (+2614427us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0808 20:00:12.031181 (+ 5708us) catalog_manager.cc:3751] Apply alter schema
0808 20:00:12.031350 (+ 169us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":560693,"Hive Metastore.run_cpu_time_us":888,"Hive Metastore.run_wall_time_us":90505}
W20260808 20:00:12.037772 22275 rpcz_store.cc:269] 0808 20:00:11.209144 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:12.024645 (+815501us) service_pool.cc:224] Handling call
0808 20:00:12.025485 (+ 840us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260808 20:00:12.031998 22278 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:38088 (request call id 34) took 2646 ms. Trace:
I20260808 20:00:12.051695 22281 rpcz_store.cc:276] 0808 20:00:09.184950 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:09.715353 (+530403us) service_pool.cc:224] Handling call
0808 20:00:11.160479 (+1445126us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0808 20:00:12.026279 (+865800us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":10471,"Hive Metastore.run_cpu_time_us":399,"Hive Metastore.run_wall_time_us":846859}
I20260808 20:00:12.035252 22284 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:38088 (request call id 35) took 2562 ms. Trace:
I20260808 20:00:12.053767 22284 rpcz_store.cc:276] 0808 20:00:09.471693 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:12.033506 (+2561813us) service_pool.cc:224] Handling call
0808 20:00:12.033810 (+ 304us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260808 20:00:12.055045 22285 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:38088 (request call id 38) took 2383 ms. Trace:
I20260808 20:00:12.055224 22285 rpcz_store.cc:276] 0808 20:00:09.671952 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:12.054603 (+2382651us) service_pool.cc:224] Handling call
0808 20:00:12.055006 (+ 403us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260808 20:00:12.056459 23273 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.21.36.125:36441)
I20260808 20:00:12.057264 22285 master_service.cc:960] ReplaceTablet: received request to replace tablet a89c8105460e45f9a77af8c7cf84607c from {username='slave'} at 127.0.0.1:38088
W20260808 20:00:12.057550 23273 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.21.36.125:36441)
I20260808 20:00:12.057942 22285 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:38088 (request call id 39) took 2305 ms. Trace:
I20260808 20:00:12.058115 22285 rpcz_store.cc:276] 0808 20:00:09.752148 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:12.057186 (+2305038us) service_pool.cc:224] Handling call
0808 20:00:12.057878 (+ 692us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260808 20:00:12.059367 23273 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.21.36.124:34593)
I20260808 20:00:12.060190 22398 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55530:
table { table_name: "default.Table_831d17f2742e4fb8bc727d56fc9d1c85" } modify_external_catalogs: true
I20260808 20:00:12.060475 22398 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55530:
table { table_name: "default.Table_831d17f2742e4fb8bc727d56fc9d1c85" } modify_external_catalogs: true
I20260808 20:00:12.060549 22275 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:38088 (request call id 37) took 2474 ms. Trace:
I20260808 20:00:12.060514 22397 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55530:
name: "default.Table_01314a1f924d4e33bdecf8797a6e2e0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:12.060658 22275 rpcz_store.cc:276] 0808 20:00:09.586074 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:12.038065 (+2451991us) service_pool.cc:224] Handling call
0808 20:00:12.060288 (+ 22223us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x616000042a54. stack: 00007fbfa0ea1326 00007fbfa0ea10e0 00007fbf9fecb34d 00000000009a5774 00000000009a573d 00007fbfb042065d 00007fbfb0420753 00007fbfacfa5ac1 00007fbfb4d7f40d 00007fbfb4f0db13 00007fbfab8f5d16 00007fbfab8f5a45 00007fbfa7fe461e 00007fbfa7fe34fe 00007fbfa7fe9738 00007fbfa7fea09f
0808 20:00:12.060510 (+ 222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9033984}
I20260808 20:00:12.052549 22278 rpcz_store.cc:276] 0808 20:00:09.385278 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:12.028678 (+2643400us) service_pool.cc:224] Handling call
0808 20:00:12.031953 (+ 3275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260808 20:00:12.061532 22278 master_service.cc:960] ReplaceTablet: received request to replace tablet d60be8ef6e8642388691bb0cd3ab2ada from {username='slave'} at 127.0.0.1:38088
I20260808 20:00:12.061918 22278 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:38088 (request call id 42) took 2144 ms. Trace:
I20260808 20:00:12.063285 22278 rpcz_store.cc:276] 0808 20:00:09.917225 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:12.061468 (+2144243us) service_pool.cc:224] Handling call
0808 20:00:12.061859 (+ 391us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260808 20:00:12.063405 22396 master_service.cc:960] ReplaceTablet: received request to replace tablet a89c8105460e45f9a77af8c7cf84607c from {username='slave'} at 127.0.0.1:55530
I20260808 20:00:12.063827 22284 master_service.cc:960] ReplaceTablet: received request to replace tablet d60be8ef6e8642388691bb0cd3ab2ada from {username='slave'} at 127.0.0.1:38088
I20260808 20:00:12.064221 22284 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:38088 (request call id 43) took 2145 ms. Trace:
I20260808 20:00:12.064347 22284 rpcz_store.cc:276] 0808 20:00:09.918666 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:12.063742 (+2145076us) service_pool.cc:224] Handling call
0808 20:00:12.064182 (+ 440us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260808 20:00:12.064999 22281 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:38088 (request call id 44) took 1841 ms. Trace:
I20260808 20:00:12.065104 22281 rpcz_store.cc:276] 0808 20:00:10.223763 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:12.064671 (+1840908us) service_pool.cc:224] Handling call
0808 20:00:12.064963 (+ 292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260808 20:00:12.065748 22281 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:38088 (request call id 45) took 1641 ms. Trace:
I20260808 20:00:12.065874 22281 rpcz_store.cc:276] 0808 20:00:10.424121 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:12.065413 (+1641292us) service_pool.cc:224] Handling call
0808 20:00:12.065714 (+ 301us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260808 20:00:12.062397 22285 master_service.cc:960] ReplaceTablet: received request to replace tablet ab9fb2ba3d5c490a992e704eb4582c82 from {username='slave'} at 127.0.0.1:38088
I20260808 20:00:12.069342 22285 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:38088 (request call id 40) took 2225 ms. Trace:
I20260808 20:00:12.070384 22285 rpcz_store.cc:276] 0808 20:00:09.843945 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:12.059902 (+2215957us) service_pool.cc:224] Handling call
0808 20:00:12.069297 (+ 9395us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1050496}
I20260808 20:00:12.071065 22396 catalog_manager.cc:6006] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: Sending DeleteTablet for 3 replicas of tablet a89c8105460e45f9a77af8c7cf84607c
I20260808 20:00:12.072245 22393 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55530:
table { table_name: "default.Table_324c660111c84a72a6935eb8e30a7ae6" } modify_external_catalogs: true
I20260808 20:00:12.072572 22393 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55530:
table { table_name: "default.Table_324c660111c84a72a6935eb8e30a7ae6" } modify_external_catalogs: true
I20260808 20:00:12.072625 22390 master_service.cc:960] ReplaceTablet: received request to replace tablet d60be8ef6e8642388691bb0cd3ab2ada from {username='slave'} at 127.0.0.1:55530
I20260808 20:00:12.072917 22394 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55530:
name: "default.Table_61bf42c8286347d197162895f70520d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:12.073117 22389 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55530:
table { table_name: "default.Table_4dc166b247ee4cf89cdd926e07b51a51" } modify_external_catalogs: true
I20260808 20:00:12.052583 22283 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:38088 (request call id 36) took 2545 ms. Trace:
I20260808 20:00:12.073338 22389 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55530:
table { table_name: "default.Table_4dc166b247ee4cf89cdd926e07b51a51" } modify_external_catalogs: true
I20260808 20:00:12.073454 22396 catalog_manager.cc:6807] ReplaceTablet: tablet a89c8105460e45f9a77af8c7cf84607c deleted and replaced by tablet c75913753d95447783b9b7c7bb6ee701
I20260808 20:00:12.073437 22283 rpcz_store.cc:276] 0808 20:00:09.506692 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:12.036721 (+2530029us) service_pool.cc:224] Handling call
0808 20:00:12.052195 (+ 15474us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x616000042a54. stack: 00007fbfa0ea1326 00007fbfa0ea10e0 00007fbf9fecb34d 00000000009a5774 00000000009a573d 00007fbfb042065d 00007fbfb0420753 00007fbfacfa5ac1 00007fbfb4d7f40d 00007fbfb4f0db13 00007fbfab8f5d16 00007fbfab8f5a45 00007fbfa7fe461e 00007fbfa7fe34fe 00007fbfa7fe9738 00007fbfa7fea09f
0808 20:00:12.052523 (+ 328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4222848}
I20260808 20:00:12.074476 22283 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:38088 (request call id 46) took 1432 ms. Trace:
I20260808 20:00:12.074604 22283 rpcz_store.cc:276] 0808 20:00:10.642066 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:12.073700 (+1431634us) service_pool.cc:224] Handling call
0808 20:00:12.074433 (+ 733us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260808 20:00:12.075147 22283 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:38088 (request call id 47) took 1159 ms. Trace:
I20260808 20:00:12.075286 22283 rpcz_store.cc:276] 0808 20:00:10.915643 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:12.074812 (+1159169us) service_pool.cc:224] Handling call
0808 20:00:12.075117 (+ 305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260808 20:00:12.072655 22388 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55530:
name: "default.Table_5a92fa3792a1443f94a707060264359c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:12.086490 22390 catalog_manager.cc:6006] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: Sending DeleteTablet for 3 replicas of tablet d60be8ef6e8642388691bb0cd3ab2ada
I20260808 20:00:12.087123 22390 catalog_manager.cc:6807] ReplaceTablet: tablet d60be8ef6e8642388691bb0cd3ab2ada deleted and replaced by tablet 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:00:12.087632 22275 master_service.cc:960] ReplaceTablet: received request to replace tablet 6ceb53121b5247b7ac83292c4c2d5416 from {username='slave'} at 127.0.0.1:38088
I20260808 20:00:12.088142 22275 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:38088 (request call id 41) took 2175 ms. Trace:
I20260808 20:00:12.088274 22275 rpcz_store.cc:276] 0808 20:00:09.913097 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:12.087512 (+2174415us) service_pool.cc:224] Handling call
0808 20:00:12.088079 (+ 567us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260808 20:00:12.088622 22283 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:38088 (request call id 48) took 1002 ms. Trace:
I20260808 20:00:12.088740 22283 rpcz_store.cc:276] 0808 20:00:11.073364 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:12.075483 (+1002119us) service_pool.cc:224] Handling call
0808 20:00:12.075770 (+ 287us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260808 20:00:12.094494 22487 catalog_manager.cc:2798] Deleting table default.table_f4c950a229114bde8c62335c66af32ed [id=373408577a474e4bb9f6ad9aec399098] in response to Hive Metastore notification log event 19
I20260808 20:00:12.117396 22390 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55530:
name: "default.Table_42e6672ee7be4c4389fcc998d6eb322d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:12.118888 22396 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55530:
name: "default.Table_ba9e157aaf3a487eb4f3f2ec9c37b761"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:12.119271 22387 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55530:
name: "default.Table_f7a6e8903ed74dc088eb1f490788c54b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:12.121210 22386 master_service.cc:960] ReplaceTablet: received request to replace tablet ab9fb2ba3d5c490a992e704eb4582c82 from {username='slave'} at 127.0.0.1:55530
I20260808 20:00:12.156420 22386 catalog_manager.cc:6006] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: Sending DeleteTablet for 3 replicas of tablet ab9fb2ba3d5c490a992e704eb4582c82
I20260808 20:00:12.157091 22386 catalog_manager.cc:6807] ReplaceTablet: tablet ab9fb2ba3d5c490a992e704eb4582c82 deleted and replaced by tablet 553ff75afb1d47d9b48410b8d6fa13dc
I20260808 20:00:12.157501 22386 master_service.cc:960] ReplaceTablet: received request to replace tablet 6ceb53121b5247b7ac83292c4c2d5416 from {username='slave'} at 127.0.0.1:55530
I20260808 20:00:12.159595 22487 catalog_manager.cc:6006] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: Sending DeleteTablet for 3 replicas of tablet 4e7bbbf891cd4500a8ec7f3d21905240
I20260808 20:00:12.162365 22906 tablet_service.cc:1558] Processing DeleteTablet for tablet a89c8105460e45f9a77af8c7cf84607c with delete_type TABLET_DATA_DELETED (replaced by tablet c75913753d95447783b9b7c7bb6ee701) from {username='slave'} at 127.0.0.1:37452
I20260808 20:00:12.176402 22908 tablet_service.cc:1558] Processing DeleteTablet for tablet d60be8ef6e8642388691bb0cd3ab2ada with delete_type TABLET_DATA_DELETED (replaced by tablet 0ef3105d34f447a592fd4de0d08f347f) from {username='slave'} at 127.0.0.1:37452
I20260808 20:00:12.177067 22287 catalog_manager.cc:2200] created HMS catalog entry for table [id=bce1917a27c14330bfe2ccc5dc0b40a3]
I20260808 20:00:12.177862 22908 tablet_service.cc:1511] Processing CreateTablet for tablet c75913753d95447783b9b7c7bb6ee701 (DEFAULT_TABLE table=default.table_752d0310c94b42d3902fffa1070bb1d4 [id=3b10ed2d37fe46a5b63d646901474c8e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260808 20:00:12.178298 22287 catalog_manager.cc:2228] Illegal state: an error occurred while writing to the sys-catalog: replica 16a59d796024414abf9f82a7593530a6 is not leader of this config: current role FOLLOWER
I20260808 20:00:12.178367 22908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c75913753d95447783b9b7c7bb6ee701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:12.193497 22903 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e7bbbf891cd4500a8ec7f3d21905240 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 20:00:12 UTC) from {username='slave'} at 127.0.0.1:37452
I20260808 20:00:12.194805 22905 tablet_service.cc:1558] Processing DeleteTablet for tablet ab9fb2ba3d5c490a992e704eb4582c82 with delete_type TABLET_DATA_DELETED (replaced by tablet 553ff75afb1d47d9b48410b8d6fa13dc) from {username='slave'} at 127.0.0.1:37452
I20260808 20:00:12.195405 22901 tablet_service.cc:1511] Processing CreateTablet for tablet 0ef3105d34f447a592fd4de0d08f347f (DEFAULT_TABLE table=default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:12.195931 22901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ef3105d34f447a592fd4de0d08f347f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:12.220031 22386 catalog_manager.cc:6006] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: Sending DeleteTablet for 3 replicas of tablet 6ceb53121b5247b7ac83292c4c2d5416
I20260808 20:00:12.220799 22386 catalog_manager.cc:6807] ReplaceTablet: tablet 6ceb53121b5247b7ac83292c4c2d5416 deleted and replaced by tablet b8948ef8ed844727b9fed1e91d9233f6
I20260808 20:00:12.222434 22901 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ceb53121b5247b7ac83292c4c2d5416 with delete_type TABLET_DATA_DELETED (replaced by tablet b8948ef8ed844727b9fed1e91d9233f6) from {username='slave'} at 127.0.0.1:37452
I20260808 20:00:12.226251 22386 master_service.cc:960] ReplaceTablet: received request to replace tablet d60be8ef6e8642388691bb0cd3ab2ada from {username='slave'} at 127.0.0.1:55530
W20260808 20:00:12.228765 22397 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_01314a1f924d4e33bdecf8797a6e2e0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260808 20:00:12.228765 22388 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_5a92fa3792a1443f94a707060264359c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260808 20:00:12.229961 22390 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_42e6672ee7be4c4389fcc998d6eb322d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260808 20:00:12.231905 22394 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_61bf42c8286347d197162895f70520d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260808 20:00:12.232303 22396 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_ba9e157aaf3a487eb4f3f2ec9c37b761 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260808 20:00:12.233867 22387 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_f7a6e8903ed74dc088eb1f490788c54b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 20:00:12.240229 22386 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55530:
name: "default.Table_f5c38573b0784ce8816d5a8a04f841d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:12.244474 22901 tablet_service.cc:1511] Processing CreateTablet for tablet 553ff75afb1d47d9b48410b8d6fa13dc (DEFAULT_TABLE table=default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:12.245137 22901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 553ff75afb1d47d9b48410b8d6fa13dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:12.264599 22905 tablet_service.cc:1511] Processing CreateTablet for tablet b8948ef8ed844727b9fed1e91d9233f6 (DEFAULT_TABLE table=default.table_324c660111c84a72a6935eb8e30a7ae6 [id=06447c1e53ac4366baae14ef41588d7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:12.265257 22905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8948ef8ed844727b9fed1e91d9233f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:12.285599 23144 tablet_service.cc:1558] Processing DeleteTablet for tablet a89c8105460e45f9a77af8c7cf84607c with delete_type TABLET_DATA_DELETED (replaced by tablet c75913753d95447783b9b7c7bb6ee701) from {username='slave'} at 127.0.0.1:59500
I20260808 20:00:12.286198 23136 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ceb53121b5247b7ac83292c4c2d5416 with delete_type TABLET_DATA_DELETED (replaced by tablet b8948ef8ed844727b9fed1e91d9233f6) from {username='slave'} at 127.0.0.1:59500
I20260808 20:00:12.286653 23141 tablet_service.cc:1558] Processing DeleteTablet for tablet ab9fb2ba3d5c490a992e704eb4582c82 with delete_type TABLET_DATA_DELETED (replaced by tablet 553ff75afb1d47d9b48410b8d6fa13dc) from {username='slave'} at 127.0.0.1:59500
I20260808 20:00:12.287626 23138 tablet_service.cc:1511] Processing CreateTablet for tablet 0ef3105d34f447a592fd4de0d08f347f (DEFAULT_TABLE table=default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:12.288189 23138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ef3105d34f447a592fd4de0d08f347f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:12.291880 23140 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e7bbbf891cd4500a8ec7f3d21905240 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 20:00:12 UTC) from {username='slave'} at 127.0.0.1:59500
I20260808 20:00:12.292579 23146 tablet_service.cc:1558] Processing DeleteTablet for tablet d60be8ef6e8642388691bb0cd3ab2ada with delete_type TABLET_DATA_DELETED (replaced by tablet 0ef3105d34f447a592fd4de0d08f347f) from {username='slave'} at 127.0.0.1:59500
I20260808 20:00:12.293340 23136 tablet_service.cc:1511] Processing CreateTablet for tablet b8948ef8ed844727b9fed1e91d9233f6 (DEFAULT_TABLE table=default.table_324c660111c84a72a6935eb8e30a7ae6 [id=06447c1e53ac4366baae14ef41588d7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:12.294029 23135 tablet_service.cc:1511] Processing CreateTablet for tablet 553ff75afb1d47d9b48410b8d6fa13dc (DEFAULT_TABLE table=default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:12.293082 23143 tablet_service.cc:1511] Processing CreateTablet for tablet c75913753d95447783b9b7c7bb6ee701 (DEFAULT_TABLE table=default.table_752d0310c94b42d3902fffa1070bb1d4 [id=3b10ed2d37fe46a5b63d646901474c8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:12.294907 23136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8948ef8ed844727b9fed1e91d9233f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:12.299823 23143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c75913753d95447783b9b7c7bb6ee701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:12.300537 23135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 553ff75afb1d47d9b48410b8d6fa13dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:12.307969 23833 tablet_bootstrap.cc:492] T c75913753d95447783b9b7c7bb6ee701 P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:12.310218 23833 tablet_bootstrap.cc:654] T c75913753d95447783b9b7c7bb6ee701 P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:12.312891 23828 tablet_replica.cc:333] T a89c8105460e45f9a77af8c7cf84607c P e34d5caee97d44fa945a91ddc6a54653: stopping tablet replica
I20260808 20:00:12.315088 23828 raft_consensus.cc:2243] T a89c8105460e45f9a77af8c7cf84607c P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:12.315596 23828 raft_consensus.cc:2272] T a89c8105460e45f9a77af8c7cf84607c P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:12.317444 23828 ts_tablet_manager.cc:1916] T a89c8105460e45f9a77af8c7cf84607c P e34d5caee97d44fa945a91ddc6a54653: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:12.322479 23836 tablet_replica.cc:333] T a89c8105460e45f9a77af8c7cf84607c P 5f6b6c2e318d44a984120a06a09e9af9: stopping tablet replica
I20260808 20:00:12.322911 23836 raft_consensus.cc:2243] T a89c8105460e45f9a77af8c7cf84607c P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:12.323228 23836 raft_consensus.cc:2272] T a89c8105460e45f9a77af8c7cf84607c P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:12.337924 23836 ts_tablet_manager.cc:1916] T a89c8105460e45f9a77af8c7cf84607c P 5f6b6c2e318d44a984120a06a09e9af9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:12.337232 23838 tablet_bootstrap.cc:492] T b8948ef8ed844727b9fed1e91d9233f6 P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:12.341100 22678 tablet_service.cc:1558] Processing DeleteTablet for tablet a89c8105460e45f9a77af8c7cf84607c with delete_type TABLET_DATA_DELETED (replaced by tablet c75913753d95447783b9b7c7bb6ee701) from {username='slave'} at 127.0.0.1:54424
I20260808 20:00:12.341187 22676 tablet_service.cc:1558] Processing DeleteTablet for tablet d60be8ef6e8642388691bb0cd3ab2ada with delete_type TABLET_DATA_DELETED (replaced by tablet 0ef3105d34f447a592fd4de0d08f347f) from {username='slave'} at 127.0.0.1:54424
I20260808 20:00:12.341910 22674 tablet_service.cc:1511] Processing CreateTablet for tablet c75913753d95447783b9b7c7bb6ee701 (DEFAULT_TABLE table=default.table_752d0310c94b42d3902fffa1070bb1d4 [id=3b10ed2d37fe46a5b63d646901474c8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:12.342489 22674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c75913753d95447783b9b7c7bb6ee701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:12.349833 22398 catalog_manager.cc:2757] deleted HMS catalog entry for table default.table_831d17f2742e4fb8bc727d56fc9d1c85 [id=b47087e2cd6349b1ba2b8daf55b2d1d5]
I20260808 20:00:12.349833 22676 tablet_service.cc:1558] Processing DeleteTablet for tablet ab9fb2ba3d5c490a992e704eb4582c82 with delete_type TABLET_DATA_DELETED (replaced by tablet 553ff75afb1d47d9b48410b8d6fa13dc) from {username='slave'} at 127.0.0.1:54424
I20260808 20:00:12.350342 22676 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e7bbbf891cd4500a8ec7f3d21905240 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 20:00:12 UTC) from {username='slave'} at 127.0.0.1:54424
I20260808 20:00:12.351109 22676 tablet_service.cc:1511] Processing CreateTablet for tablet 0ef3105d34f447a592fd4de0d08f347f (DEFAULT_TABLE table=default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:12.351639 22676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ef3105d34f447a592fd4de0d08f347f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:12.357699 23841 tablet_replica.cc:333] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e: stopping tablet replica
I20260808 20:00:12.357969 23841 raft_consensus.cc:2243] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e [term 1 LEADER]: Raft consensus shutting down.
I20260808 20:00:12.359802 22673 tablet_service.cc:1511] Processing CreateTablet for tablet 553ff75afb1d47d9b48410b8d6fa13dc (DEFAULT_TABLE table=default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:12.360304 22673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 553ff75afb1d47d9b48410b8d6fa13dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:12.340917 23838 tablet_bootstrap.cc:654] T b8948ef8ed844727b9fed1e91d9233f6 P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:12.365937 22277 catalog_manager.cc:2757] deleted HMS catalog entry for table default.table_752d0310c94b42d3902fffa1070bb1d4 [id=3b10ed2d37fe46a5b63d646901474c8e]
I20260808 20:00:12.369202 22678 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ceb53121b5247b7ac83292c4c2d5416 with delete_type TABLET_DATA_DELETED (replaced by tablet b8948ef8ed844727b9fed1e91d9233f6) from {username='slave'} at 127.0.0.1:54424
I20260808 20:00:12.370297 22277 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:38088 (request call id 32) took 3064 ms. Trace:
I20260808 20:00:12.370596 23836 ts_tablet_manager.cc:1929] T a89c8105460e45f9a77af8c7cf84607c P 5f6b6c2e318d44a984120a06a09e9af9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260808 20:00:12.370453 22277 rpcz_store.cc:276] 0808 20:00:09.305983 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:10.763431 (+1457448us) service_pool.cc:224] Handling call
0808 20:00:12.024326 (+1260895us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0808 20:00:12.370216 (+345890us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":152321,"Hive Metastore.run_cpu_time_us":239,"Hive Metastore.run_wall_time_us":188780}
I20260808 20:00:12.370759 23836 log.cc:1199] T a89c8105460e45f9a77af8c7cf84607c P 5f6b6c2e318d44a984120a06a09e9af9: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/wal/wals/a89c8105460e45f9a77af8c7cf84607c
I20260808 20:00:12.371248 23836 ts_tablet_manager.cc:1950] T a89c8105460e45f9a77af8c7cf84607c P 5f6b6c2e318d44a984120a06a09e9af9: Deleting consensus metadata
I20260808 20:00:12.372114 22674 tablet_service.cc:1511] Processing CreateTablet for tablet b8948ef8ed844727b9fed1e91d9233f6 (DEFAULT_TABLE table=default.table_324c660111c84a72a6935eb8e30a7ae6 [id=06447c1e53ac4366baae14ef41588d7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:12.372661 22674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8948ef8ed844727b9fed1e91d9233f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:12.375959 23833 tablet_bootstrap.cc:492] T c75913753d95447783b9b7c7bb6ee701 P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:12.376189 23833 ts_tablet_manager.cc:1403] T c75913753d95447783b9b7c7bb6ee701 P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.068s user 0.004s sys 0.000s
I20260808 20:00:12.377219 23833 raft_consensus.cc:359] T c75913753d95447783b9b7c7bb6ee701 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.377475 23833 raft_consensus.cc:385] T c75913753d95447783b9b7c7bb6ee701 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:12.377589 23833 raft_consensus.cc:740] T c75913753d95447783b9b7c7bb6ee701 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:12.377851 23833 consensus_queue.cc:260] T c75913753d95447783b9b7c7bb6ee701 P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.379526 23842 tablet_bootstrap.cc:492] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:12.379760 22380 catalog_manager.cc:5050] TS 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): tablet a89c8105460e45f9a77af8c7cf84607c (table default.table_752d0310c94b42d3902fffa1070bb1d4 [id=3b10ed2d37fe46a5b63d646901474c8e]) successfully deleted
I20260808 20:00:12.380640 23841 raft_consensus.cc:2272] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:12.381412 23841 ts_tablet_manager.cc:1916] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:12.381659 23842 tablet_bootstrap.cc:654] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:12.384335 23833 ts_tablet_manager.cc:1434] T c75913753d95447783b9b7c7bb6ee701 P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260808 20:00:12.387698 23833 tablet_bootstrap.cc:492] T 0ef3105d34f447a592fd4de0d08f347f P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:12.388505 23841 ts_tablet_manager.cc:1929] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260808 20:00:12.388662 23841 log.cc:1199] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-0/wal/wals/a89c8105460e45f9a77af8c7cf84607c
I20260808 20:00:12.389111 23841 ts_tablet_manager.cc:1950] T a89c8105460e45f9a77af8c7cf84607c P 257c9c7e0c6c441593eac06beb31fa4e: Deleting consensus metadata
I20260808 20:00:12.389644 23833 tablet_bootstrap.cc:654] T 0ef3105d34f447a592fd4de0d08f347f P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:12.390318 23841 tablet_replica.cc:333] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e: stopping tablet replica
I20260808 20:00:12.390534 23841 raft_consensus.cc:2243] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e [term 1 LEADER]: Raft consensus shutting down.
I20260808 20:00:12.390527 22378 catalog_manager.cc:5050] TS 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): tablet a89c8105460e45f9a77af8c7cf84607c (table default.table_752d0310c94b42d3902fffa1070bb1d4 [id=3b10ed2d37fe46a5b63d646901474c8e]) successfully deleted
I20260808 20:00:12.390909 23841 raft_consensus.cc:2272] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:12.392244 23838 tablet_bootstrap.cc:492] T b8948ef8ed844727b9fed1e91d9233f6 P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:12.392422 23838 ts_tablet_manager.cc:1403] T b8948ef8ed844727b9fed1e91d9233f6 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.055s user 0.003s sys 0.002s
I20260808 20:00:12.393309 23838 raft_consensus.cc:359] T b8948ef8ed844727b9fed1e91d9233f6 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.393519 23838 raft_consensus.cc:385] T b8948ef8ed844727b9fed1e91d9233f6 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:12.393621 23838 raft_consensus.cc:740] T b8948ef8ed844727b9fed1e91d9233f6 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:12.393925 23838 consensus_queue.cc:260] T b8948ef8ed844727b9fed1e91d9233f6 P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.394423 23836 tablet_replica.cc:333] T 6ceb53121b5247b7ac83292c4c2d5416 P 5f6b6c2e318d44a984120a06a09e9af9: stopping tablet replica
I20260808 20:00:12.394690 23836 raft_consensus.cc:2243] T 6ceb53121b5247b7ac83292c4c2d5416 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:12.394956 23836 raft_consensus.cc:2272] T 6ceb53121b5247b7ac83292c4c2d5416 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:12.395645 23836 ts_tablet_manager.cc:1916] T 6ceb53121b5247b7ac83292c4c2d5416 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:12.392776 23828 ts_tablet_manager.cc:1929] T a89c8105460e45f9a77af8c7cf84607c P e34d5caee97d44fa945a91ddc6a54653: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260808 20:00:12.396201 23828 log.cc:1199] T a89c8105460e45f9a77af8c7cf84607c P e34d5caee97d44fa945a91ddc6a54653: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/wal/wals/a89c8105460e45f9a77af8c7cf84607c
I20260808 20:00:12.396817 23828 ts_tablet_manager.cc:1950] T a89c8105460e45f9a77af8c7cf84607c P e34d5caee97d44fa945a91ddc6a54653: Deleting consensus metadata
I20260808 20:00:12.398806 23842 tablet_bootstrap.cc:492] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:12.400842 23828 tablet_replica.cc:333] T d60be8ef6e8642388691bb0cd3ab2ada P e34d5caee97d44fa945a91ddc6a54653: stopping tablet replica
I20260808 20:00:12.401129 23842 ts_tablet_manager.cc:1403] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.004s
I20260808 20:00:12.401116 22378 catalog_manager.cc:5050] TS e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): tablet a89c8105460e45f9a77af8c7cf84607c (table default.table_752d0310c94b42d3902fffa1070bb1d4 [id=3b10ed2d37fe46a5b63d646901474c8e]) successfully deleted
I20260808 20:00:12.401962 23838 ts_tablet_manager.cc:1434] T b8948ef8ed844727b9fed1e91d9233f6 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260808 20:00:12.402397 23828 raft_consensus.cc:2243] T d60be8ef6e8642388691bb0cd3ab2ada P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:12.402648 23828 raft_consensus.cc:2272] T d60be8ef6e8642388691bb0cd3ab2ada P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:12.403544 23838 tablet_bootstrap.cc:492] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:12.403450 23842 raft_consensus.cc:359] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.403792 23842 raft_consensus.cc:385] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:12.404524 23828 ts_tablet_manager.cc:1916] T d60be8ef6e8642388691bb0cd3ab2ada P e34d5caee97d44fa945a91ddc6a54653: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:12.404721 23842 raft_consensus.cc:740] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:12.405117 23842 consensus_queue.cc:260] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.406908 23838 tablet_bootstrap.cc:654] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:12.406908 23842 ts_tablet_manager.cc:1434] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260808 20:00:12.410950 23833 tablet_bootstrap.cc:492] T 0ef3105d34f447a592fd4de0d08f347f P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:12.411206 23833 ts_tablet_manager.cc:1403] T 0ef3105d34f447a592fd4de0d08f347f P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s
I20260808 20:00:12.412147 23833 raft_consensus.cc:359] T 0ef3105d34f447a592fd4de0d08f347f P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.412495 23833 raft_consensus.cc:385] T 0ef3105d34f447a592fd4de0d08f347f P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:12.412643 23833 raft_consensus.cc:740] T 0ef3105d34f447a592fd4de0d08f347f P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:12.413025 23833 consensus_queue.cc:260] T 0ef3105d34f447a592fd4de0d08f347f P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.415207 23846 consensus_queue.cc:1048] T 286e98ffe9b44ada92fd8e9776578df2 P 5f6b6c2e318d44a984120a06a09e9af9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:12.416767 23838 tablet_bootstrap.cc:492] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:12.418505 23833 ts_tablet_manager.cc:1434] T 0ef3105d34f447a592fd4de0d08f347f P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260808 20:00:12.416953 23838 ts_tablet_manager.cc:1403] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.001s
I20260808 20:00:12.420719 23838 raft_consensus.cc:359] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.420962 23838 raft_consensus.cc:385] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:12.421044 23838 raft_consensus.cc:740] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:12.426321 23833 tablet_bootstrap.cc:492] T b8948ef8ed844727b9fed1e91d9233f6 P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:12.428040 23838 consensus_queue.cc:260] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.428880 22791 heartbeater.cc:499] Master 127.21.36.124:34593 was elected leader, sending a full tablet report...
I20260808 20:00:12.432540 23828 ts_tablet_manager.cc:1929] T d60be8ef6e8642388691bb0cd3ab2ada P e34d5caee97d44fa945a91ddc6a54653: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 20:00:12.432650 23838 ts_tablet_manager.cc:1434] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260808 20:00:12.432731 23828 log.cc:1199] T d60be8ef6e8642388691bb0cd3ab2ada P e34d5caee97d44fa945a91ddc6a54653: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/wal/wals/d60be8ef6e8642388691bb0cd3ab2ada
I20260808 20:00:12.434746 23842 tablet_bootstrap.cc:492] T 553ff75afb1d47d9b48410b8d6fa13dc P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:12.435601 23833 tablet_bootstrap.cc:654] T b8948ef8ed844727b9fed1e91d9233f6 P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:12.433178 23828 ts_tablet_manager.cc:1950] T d60be8ef6e8642388691bb0cd3ab2ada P e34d5caee97d44fa945a91ddc6a54653: Deleting consensus metadata
I20260808 20:00:12.437844 23842 tablet_bootstrap.cc:654] T 553ff75afb1d47d9b48410b8d6fa13dc P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:12.438145 22378 catalog_manager.cc:5050] TS e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): tablet d60be8ef6e8642388691bb0cd3ab2ada (table default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619]) successfully deleted
I20260808 20:00:12.438478 23838 tablet_bootstrap.cc:492] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:12.439035 23841 ts_tablet_manager.cc:1916] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:12.440465 23828 tablet_replica.cc:333] T 4e7bbbf891cd4500a8ec7f3d21905240 P e34d5caee97d44fa945a91ddc6a54653: stopping tablet replica
I20260808 20:00:12.440701 23828 raft_consensus.cc:2243] T 4e7bbbf891cd4500a8ec7f3d21905240 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:12.440932 23828 raft_consensus.cc:2272] T 4e7bbbf891cd4500a8ec7f3d21905240 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:12.441541 23828 ts_tablet_manager.cc:1916] T 4e7bbbf891cd4500a8ec7f3d21905240 P e34d5caee97d44fa945a91ddc6a54653: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:12.441951 23838 tablet_bootstrap.cc:654] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:12.444614 23846 consensus_queue.cc:1048] T 286e98ffe9b44ada92fd8e9776578df2 P 5f6b6c2e318d44a984120a06a09e9af9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:12.463845 23842 tablet_bootstrap.cc:492] T 553ff75afb1d47d9b48410b8d6fa13dc P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:12.464187 23842 ts_tablet_manager.cc:1403] T 553ff75afb1d47d9b48410b8d6fa13dc P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.000s
I20260808 20:00:12.465174 23842 raft_consensus.cc:359] T 553ff75afb1d47d9b48410b8d6fa13dc P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.465524 23842 raft_consensus.cc:385] T 553ff75afb1d47d9b48410b8d6fa13dc P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:12.465668 23842 raft_consensus.cc:740] T 553ff75afb1d47d9b48410b8d6fa13dc P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:12.467198 23520 raft_consensus.cc:493] T c75913753d95447783b9b7c7bb6ee701 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:12.467413 23520 raft_consensus.cc:515] T c75913753d95447783b9b7c7bb6ee701 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.468273 23520 leader_election.cc:290] T c75913753d95447783b9b7c7bb6ee701 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:12.469625 23177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75913753d95447783b9b7c7bb6ee701" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9" is_pre_election: true
W20260808 20:00:12.470425 22835 leader_election.cc:343] T c75913753d95447783b9b7c7bb6ee701 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Illegal state: must be running to vote when last-logged opid is not known
I20260808 20:00:12.470764 23838 tablet_bootstrap.cc:492] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:12.470942 23838 ts_tablet_manager.cc:1403] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.014s
I20260808 20:00:12.471853 23838 raft_consensus.cc:359] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.472064 23838 raft_consensus.cc:385] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:12.472179 23838 raft_consensus.cc:740] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:12.469291 22711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75913753d95447783b9b7c7bb6ee701" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e" is_pre_election: true
W20260808 20:00:12.474067 22831 leader_election.cc:343] T c75913753d95447783b9b7c7bb6ee701 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Illegal state: must be running to vote when last-logged opid is not known
I20260808 20:00:12.474221 22831 leader_election.cc:304] T c75913753d95447783b9b7c7bb6ee701 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e34d5caee97d44fa945a91ddc6a54653; no voters: 257c9c7e0c6c441593eac06beb31fa4e, 5f6b6c2e318d44a984120a06a09e9af9
I20260808 20:00:12.474723 23520 raft_consensus.cc:2749] T c75913753d95447783b9b7c7bb6ee701 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 20:00:12.466099 23842 consensus_queue.cc:260] T 553ff75afb1d47d9b48410b8d6fa13dc P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.476665 22288 catalog_manager.cc:2200] created HMS catalog entry for table [id=1ba38449531f437d8795f5e35a3f9479]
W20260808 20:00:12.477638 22288 catalog_manager.cc:2228] Illegal state: an error occurred while writing to the sys-catalog: replica 16a59d796024414abf9f82a7593530a6 is not leader of this config: current role FOLLOWER
I20260808 20:00:12.479207 23842 ts_tablet_manager.cc:1434] T 553ff75afb1d47d9b48410b8d6fa13dc P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.015s user 0.001s sys 0.000s
I20260808 20:00:12.479405 23836 ts_tablet_manager.cc:1929] T 6ceb53121b5247b7ac83292c4c2d5416 P 5f6b6c2e318d44a984120a06a09e9af9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260808 20:00:12.479700 23836 log.cc:1199] T 6ceb53121b5247b7ac83292c4c2d5416 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/wal/wals/6ceb53121b5247b7ac83292c4c2d5416
I20260808 20:00:12.481169 23836 ts_tablet_manager.cc:1950] T 6ceb53121b5247b7ac83292c4c2d5416 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting consensus metadata
I20260808 20:00:12.483186 23842 tablet_bootstrap.cc:492] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:12.493460 23833 tablet_bootstrap.cc:492] T b8948ef8ed844727b9fed1e91d9233f6 P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:12.493659 23833 ts_tablet_manager.cc:1403] T b8948ef8ed844727b9fed1e91d9233f6 P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.067s user 0.010s sys 0.001s
I20260808 20:00:12.494513 23833 raft_consensus.cc:359] T b8948ef8ed844727b9fed1e91d9233f6 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.494724 23833 raft_consensus.cc:385] T b8948ef8ed844727b9fed1e91d9233f6 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:12.494815 23833 raft_consensus.cc:740] T b8948ef8ed844727b9fed1e91d9233f6 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:12.495069 23833 consensus_queue.cc:260] T b8948ef8ed844727b9fed1e91d9233f6 P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.497715 23836 tablet_replica.cc:333] T ab9fb2ba3d5c490a992e704eb4582c82 P 5f6b6c2e318d44a984120a06a09e9af9: stopping tablet replica
I20260808 20:00:12.499442 22380 catalog_manager.cc:5050] TS 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): tablet 6ceb53121b5247b7ac83292c4c2d5416 (table default.table_324c660111c84a72a6935eb8e30a7ae6 [id=06447c1e53ac4366baae14ef41588d7f]) successfully deleted
I20260808 20:00:12.504006 23833 ts_tablet_manager.cc:1434] T b8948ef8ed844727b9fed1e91d9233f6 P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260808 20:00:12.508023 23833 tablet_bootstrap.cc:492] T 553ff75afb1d47d9b48410b8d6fa13dc P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:12.510020 23833 tablet_bootstrap.cc:654] T 553ff75afb1d47d9b48410b8d6fa13dc P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:12.515252 23828 ts_tablet_manager.cc:1929] T 4e7bbbf891cd4500a8ec7f3d21905240 P e34d5caee97d44fa945a91ddc6a54653: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260808 20:00:12.515425 23828 log.cc:1199] T 4e7bbbf891cd4500a8ec7f3d21905240 P e34d5caee97d44fa945a91ddc6a54653: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/wal/wals/4e7bbbf891cd4500a8ec7f3d21905240
I20260808 20:00:12.515890 23828 ts_tablet_manager.cc:1950] T 4e7bbbf891cd4500a8ec7f3d21905240 P e34d5caee97d44fa945a91ddc6a54653: Deleting consensus metadata
I20260808 20:00:12.517158 22378 catalog_manager.cc:5050] TS e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): tablet 4e7bbbf891cd4500a8ec7f3d21905240 (table default.table_f4c950a229114bde8c62335c66af32ed [id=373408577a474e4bb9f6ad9aec399098]) successfully deleted
I20260808 20:00:12.518426 23842 tablet_bootstrap.cc:654] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:12.505703 23838 consensus_queue.cc:260] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.520476 23838 ts_tablet_manager.cc:1434] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.049s user 0.002s sys 0.000s
I20260808 20:00:12.520912 23838 tablet_bootstrap.cc:492] T c75913753d95447783b9b7c7bb6ee701 P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:12.522637 23828 tablet_replica.cc:333] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653: stopping tablet replica
I20260808 20:00:12.522888 23828 raft_consensus.cc:2243] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653 [term 1 LEADER]: Raft consensus shutting down.
I20260808 20:00:12.523366 23828 raft_consensus.cc:2272] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:12.523489 23838 tablet_bootstrap.cc:654] T c75913753d95447783b9b7c7bb6ee701 P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:12.524094 23828 ts_tablet_manager.cc:1916] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:12.525565 23836 raft_consensus.cc:2243] T ab9fb2ba3d5c490a992e704eb4582c82 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:12.525760 23838 tablet_bootstrap.cc:492] T c75913753d95447783b9b7c7bb6ee701 P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:12.525954 23838 ts_tablet_manager.cc:1403] T c75913753d95447783b9b7c7bb6ee701 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.002s
I20260808 20:00:12.526880 23833 tablet_bootstrap.cc:492] T 553ff75afb1d47d9b48410b8d6fa13dc P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:12.527061 23833 ts_tablet_manager.cc:1403] T 553ff75afb1d47d9b48410b8d6fa13dc P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20260808 20:00:12.527258 23838 raft_consensus.cc:359] T c75913753d95447783b9b7c7bb6ee701 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.527848 23838 raft_consensus.cc:385] T c75913753d95447783b9b7c7bb6ee701 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:12.527951 23838 raft_consensus.cc:740] T c75913753d95447783b9b7c7bb6ee701 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:12.528259 23838 consensus_queue.cc:260] T c75913753d95447783b9b7c7bb6ee701 P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.528823 23838 ts_tablet_manager.cc:1434] T c75913753d95447783b9b7c7bb6ee701 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260808 20:00:12.527932 23833 raft_consensus.cc:359] T 553ff75afb1d47d9b48410b8d6fa13dc P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.529170 23833 raft_consensus.cc:385] T 553ff75afb1d47d9b48410b8d6fa13dc P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:12.529268 23833 raft_consensus.cc:740] T 553ff75afb1d47d9b48410b8d6fa13dc P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:12.529466 23841 ts_tablet_manager.cc:1929] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 20:00:12.529525 23833 consensus_queue.cc:260] T 553ff75afb1d47d9b48410b8d6fa13dc P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.529644 23841 log.cc:1199] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-0/wal/wals/d60be8ef6e8642388691bb0cd3ab2ada
I20260808 20:00:12.530108 23841 ts_tablet_manager.cc:1950] T d60be8ef6e8642388691bb0cd3ab2ada P 257c9c7e0c6c441593eac06beb31fa4e: Deleting consensus metadata
I20260808 20:00:12.525930 23836 raft_consensus.cc:2272] T ab9fb2ba3d5c490a992e704eb4582c82 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:12.531870 23836 ts_tablet_manager.cc:1916] T ab9fb2ba3d5c490a992e704eb4582c82 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:12.534523 23833 ts_tablet_manager.cc:1434] T 553ff75afb1d47d9b48410b8d6fa13dc P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260808 20:00:12.538631 23842 tablet_bootstrap.cc:492] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:12.538848 23842 ts_tablet_manager.cc:1403] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.056s user 0.001s sys 0.003s
I20260808 20:00:12.542441 23841 tablet_replica.cc:333] T ab9fb2ba3d5c490a992e704eb4582c82 P 257c9c7e0c6c441593eac06beb31fa4e: stopping tablet replica
I20260808 20:00:12.542434 22378 catalog_manager.cc:5050] TS 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): tablet d60be8ef6e8642388691bb0cd3ab2ada (table default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619]) successfully deleted
I20260808 20:00:12.542707 23841 raft_consensus.cc:2243] T ab9fb2ba3d5c490a992e704eb4582c82 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:12.543074 23841 raft_consensus.cc:2272] T ab9fb2ba3d5c490a992e704eb4582c82 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:12.543848 23841 ts_tablet_manager.cc:1916] T ab9fb2ba3d5c490a992e704eb4582c82 P 257c9c7e0c6c441593eac06beb31fa4e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:12.550081 23842 raft_consensus.cc:359] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.550422 23842 raft_consensus.cc:385] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:12.550534 23842 raft_consensus.cc:740] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:12.550889 23842 consensus_queue.cc:260] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.555693 23836 ts_tablet_manager.cc:1929] T ab9fb2ba3d5c490a992e704eb4582c82 P 5f6b6c2e318d44a984120a06a09e9af9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 20:00:12.556610 23842 ts_tablet_manager.cc:1434] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.018s user 0.000s sys 0.003s
I20260808 20:00:12.556968 23842 tablet_bootstrap.cc:492] T b8948ef8ed844727b9fed1e91d9233f6 P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:12.559773 23828 ts_tablet_manager.cc:1929] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 20:00:12.559963 23828 log.cc:1199] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/wal/wals/ab9fb2ba3d5c490a992e704eb4582c82
I20260808 20:00:12.560395 23828 ts_tablet_manager.cc:1950] T ab9fb2ba3d5c490a992e704eb4582c82 P e34d5caee97d44fa945a91ddc6a54653: Deleting consensus metadata
I20260808 20:00:12.561723 22378 catalog_manager.cc:5050] TS e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): tablet ab9fb2ba3d5c490a992e704eb4582c82 (table default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528]) successfully deleted
I20260808 20:00:12.562671 23842 tablet_bootstrap.cc:654] T b8948ef8ed844727b9fed1e91d9233f6 P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:12.563840 23836 log.cc:1199] T ab9fb2ba3d5c490a992e704eb4582c82 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/wal/wals/ab9fb2ba3d5c490a992e704eb4582c82
I20260808 20:00:12.564397 23836 ts_tablet_manager.cc:1950] T ab9fb2ba3d5c490a992e704eb4582c82 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting consensus metadata
I20260808 20:00:12.566735 23841 ts_tablet_manager.cc:1929] T ab9fb2ba3d5c490a992e704eb4582c82 P 257c9c7e0c6c441593eac06beb31fa4e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 20:00:12.566908 23841 log.cc:1199] T ab9fb2ba3d5c490a992e704eb4582c82 P 257c9c7e0c6c441593eac06beb31fa4e: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-0/wal/wals/ab9fb2ba3d5c490a992e704eb4582c82
I20260808 20:00:12.567402 23841 ts_tablet_manager.cc:1950] T ab9fb2ba3d5c490a992e704eb4582c82 P 257c9c7e0c6c441593eac06beb31fa4e: Deleting consensus metadata
I20260808 20:00:12.567765 23828 tablet_replica.cc:333] T 6ceb53121b5247b7ac83292c4c2d5416 P e34d5caee97d44fa945a91ddc6a54653: stopping tablet replica
I20260808 20:00:12.567992 23828 raft_consensus.cc:2243] T 6ceb53121b5247b7ac83292c4c2d5416 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:12.568228 23828 raft_consensus.cc:2272] T 6ceb53121b5247b7ac83292c4c2d5416 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:12.568745 22380 catalog_manager.cc:5050] TS 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): tablet ab9fb2ba3d5c490a992e704eb4582c82 (table default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528]) successfully deleted
I20260808 20:00:12.568895 23828 ts_tablet_manager.cc:1916] T 6ceb53121b5247b7ac83292c4c2d5416 P e34d5caee97d44fa945a91ddc6a54653: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:12.569206 23836 tablet_replica.cc:333] T 4e7bbbf891cd4500a8ec7f3d21905240 P 5f6b6c2e318d44a984120a06a09e9af9: stopping tablet replica
I20260808 20:00:12.569482 23836 raft_consensus.cc:2243] T 4e7bbbf891cd4500a8ec7f3d21905240 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:12.569708 23836 raft_consensus.cc:2272] T 4e7bbbf891cd4500a8ec7f3d21905240 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:12.570429 23836 ts_tablet_manager.cc:1916] T 4e7bbbf891cd4500a8ec7f3d21905240 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:12.571218 23772 catalog_manager.cc:1295] Loaded cluster ID: 9c4ad126d38943188e9e4422f5e27418
I20260808 20:00:12.571329 23772 catalog_manager.cc:1588] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: loading cluster ID for follower catalog manager: success
I20260808 20:00:12.573408 22378 catalog_manager.cc:5050] TS 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): tablet ab9fb2ba3d5c490a992e704eb4582c82 (table default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528]) successfully deleted
I20260808 20:00:12.575037 23841 tablet_replica.cc:333] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e: stopping tablet replica
I20260808 20:00:12.575353 23841 raft_consensus.cc:2243] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 LEADER]: Raft consensus shutting down.
I20260808 20:00:12.579144 23841 raft_consensus.cc:2272] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:12.579917 23841 ts_tablet_manager.cc:1916] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:12.581372 22389 catalog_manager.cc:2757] deleted HMS catalog entry for table default.table_4dc166b247ee4cf89cdd926e07b51a51 [id=355ea74a32ec4502b6679611e8c8b67e]
I20260808 20:00:12.578697 23842 tablet_bootstrap.cc:492] T b8948ef8ed844727b9fed1e91d9233f6 P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:12.583719 23842 ts_tablet_manager.cc:1403] T b8948ef8ed844727b9fed1e91d9233f6 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.027s user 0.005s sys 0.001s
I20260808 20:00:12.584661 23842 raft_consensus.cc:359] T b8948ef8ed844727b9fed1e91d9233f6 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.584903 23842 raft_consensus.cc:385] T b8948ef8ed844727b9fed1e91d9233f6 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:12.584990 23842 raft_consensus.cc:740] T b8948ef8ed844727b9fed1e91d9233f6 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:12.585354 23842 consensus_queue.cc:260] T b8948ef8ed844727b9fed1e91d9233f6 P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.585464 23828 ts_tablet_manager.cc:1929] T 6ceb53121b5247b7ac83292c4c2d5416 P e34d5caee97d44fa945a91ddc6a54653: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260808 20:00:12.585631 23828 log.cc:1199] T 6ceb53121b5247b7ac83292c4c2d5416 P e34d5caee97d44fa945a91ddc6a54653: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/wal/wals/6ceb53121b5247b7ac83292c4c2d5416
I20260808 20:00:12.586110 23828 ts_tablet_manager.cc:1950] T 6ceb53121b5247b7ac83292c4c2d5416 P e34d5caee97d44fa945a91ddc6a54653: Deleting consensus metadata
I20260808 20:00:12.586206 23842 ts_tablet_manager.cc:1434] T b8948ef8ed844727b9fed1e91d9233f6 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260808 20:00:12.586530 23845 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:12.586699 23845 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.587531 23845 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:12.588068 22378 catalog_manager.cc:5050] TS e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): tablet 6ceb53121b5247b7ac83292c4c2d5416 (table default.table_324c660111c84a72a6935eb8e30a7ae6 [id=06447c1e53ac4366baae14ef41588d7f]) successfully deleted
I20260808 20:00:12.591169 22941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef3105d34f447a592fd4de0d08f347f" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653" is_pre_election: true
I20260808 20:00:12.591492 22941 raft_consensus.cc:2468] T 0ef3105d34f447a592fd4de0d08f347f P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 0.
I20260808 20:00:12.592272 22711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef3105d34f447a592fd4de0d08f347f" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e" is_pre_election: true
I20260808 20:00:12.592554 22711 raft_consensus.cc:2468] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 0.
I20260808 20:00:12.593434 23066 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:12.598125 23772 catalog_manager.cc:1610] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: acquiring CA information for follower catalog manager: success
I20260808 20:00:12.598328 23845 raft_consensus.cc:2804] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:12.598480 23845 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:12.598580 23845 raft_consensus.cc:3060] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:12.601612 23772 catalog_manager.cc:1638] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 20:00:12.601671 23845 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.603212 22711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef3105d34f447a592fd4de0d08f347f" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e"
I20260808 20:00:12.603504 22711 raft_consensus.cc:3060] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:12.607100 22711 raft_consensus.cc:2468] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 1.
I20260808 20:00:12.608021 23066 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, 5f6b6c2e318d44a984120a06a09e9af9; no voters:
I20260808 20:00:12.608451 23846 raft_consensus.cc:2804] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:12.612109 22941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef3105d34f447a592fd4de0d08f347f" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653"
I20260808 20:00:12.612388 22941 raft_consensus.cc:3060] T 0ef3105d34f447a592fd4de0d08f347f P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:12.615857 22941 raft_consensus.cc:2468] T 0ef3105d34f447a592fd4de0d08f347f P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 1.
I20260808 20:00:12.617197 23845 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 election: Requested vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:12.623644 22282 catalog_manager.cc:2200] created HMS catalog entry for table [id=95d1dc4138bd491da51e09440dab7eee]
W20260808 20:00:12.624720 22282 catalog_manager.cc:2228] Illegal state: an error occurred while writing to the sys-catalog: replica 16a59d796024414abf9f82a7593530a6 is not leader of this config: current role FOLLOWER
I20260808 20:00:12.630620 23846 raft_consensus.cc:697] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 LEADER]: Becoming Leader. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Running, Role: LEADER
I20260808 20:00:12.631258 23846 consensus_queue.cc:237] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.638139 23836 ts_tablet_manager.cc:1929] T 4e7bbbf891cd4500a8ec7f3d21905240 P 5f6b6c2e318d44a984120a06a09e9af9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260808 20:00:12.638520 23836 log.cc:1199] T 4e7bbbf891cd4500a8ec7f3d21905240 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/wal/wals/4e7bbbf891cd4500a8ec7f3d21905240
I20260808 20:00:12.639345 23836 ts_tablet_manager.cc:1950] T 4e7bbbf891cd4500a8ec7f3d21905240 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting consensus metadata
I20260808 20:00:12.643713 22380 catalog_manager.cc:5050] TS 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): tablet 4e7bbbf891cd4500a8ec7f3d21905240 (table default.table_f4c950a229114bde8c62335c66af32ed [id=373408577a474e4bb9f6ad9aec399098]) successfully deleted
I20260808 20:00:12.645009 23836 tablet_replica.cc:333] T d60be8ef6e8642388691bb0cd3ab2ada P 5f6b6c2e318d44a984120a06a09e9af9: stopping tablet replica
I20260808 20:00:12.641192 23841 ts_tablet_manager.cc:1929] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260808 20:00:12.645612 23841 log.cc:1199] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-0/wal/wals/4e7bbbf891cd4500a8ec7f3d21905240
I20260808 20:00:12.646023 23836 raft_consensus.cc:2243] T d60be8ef6e8642388691bb0cd3ab2ada P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:12.647001 23836 raft_consensus.cc:2272] T d60be8ef6e8642388691bb0cd3ab2ada P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:12.647548 23841 ts_tablet_manager.cc:1950] T 4e7bbbf891cd4500a8ec7f3d21905240 P 257c9c7e0c6c441593eac06beb31fa4e: Deleting consensus metadata
I20260808 20:00:12.648630 23836 ts_tablet_manager.cc:1916] T d60be8ef6e8642388691bb0cd3ab2ada P 5f6b6c2e318d44a984120a06a09e9af9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:12.651773 22378 catalog_manager.cc:5050] TS 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): tablet 4e7bbbf891cd4500a8ec7f3d21905240 (table default.table_f4c950a229114bde8c62335c66af32ed [id=373408577a474e4bb9f6ad9aec399098]) successfully deleted
I20260808 20:00:12.662091 23841 tablet_replica.cc:333] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e: stopping tablet replica
I20260808 20:00:12.662601 23841 raft_consensus.cc:2243] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 LEADER]: Raft consensus shutting down.
I20260808 20:00:12.663137 23841 raft_consensus.cc:2272] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:12.664023 23841 ts_tablet_manager.cc:1916] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:12.671177 23841 ts_tablet_manager.cc:1929] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260808 20:00:12.676059 23836 ts_tablet_manager.cc:1929] T d60be8ef6e8642388691bb0cd3ab2ada P 5f6b6c2e318d44a984120a06a09e9af9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 20:00:12.676370 23836 log.cc:1199] T d60be8ef6e8642388691bb0cd3ab2ada P 5f6b6c2e318d44a984120a06a09e9af9: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/wal/wals/d60be8ef6e8642388691bb0cd3ab2ada
I20260808 20:00:12.676982 23836 ts_tablet_manager.cc:1950] T d60be8ef6e8642388691bb0cd3ab2ada P 5f6b6c2e318d44a984120a06a09e9af9: Deleting consensus metadata
I20260808 20:00:12.678666 22380 catalog_manager.cc:5050] TS 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): tablet d60be8ef6e8642388691bb0cd3ab2ada (table default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619]) successfully deleted
I20260808 20:00:12.679215 23841 log.cc:1199] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-0/wal/wals/6ceb53121b5247b7ac83292c4c2d5416
I20260808 20:00:12.679863 23841 ts_tablet_manager.cc:1950] T 6ceb53121b5247b7ac83292c4c2d5416 P 257c9c7e0c6c441593eac06beb31fa4e: Deleting consensus metadata
I20260808 20:00:12.681524 22378 catalog_manager.cc:5050] TS 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): tablet 6ceb53121b5247b7ac83292c4c2d5416 (table default.table_324c660111c84a72a6935eb8e30a7ae6 [id=06447c1e53ac4366baae14ef41588d7f]) successfully deleted
I20260808 20:00:12.690738 23561 raft_consensus.cc:493] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:12.690999 23561 raft_consensus.cc:515] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.691814 23561 leader_election.cc:290] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:12.693341 22941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75913753d95447783b9b7c7bb6ee701" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653" is_pre_election: true
I20260808 20:00:12.693603 22941 raft_consensus.cc:2468] T c75913753d95447783b9b7c7bb6ee701 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 0.
I20260808 20:00:12.694065 23177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75913753d95447783b9b7c7bb6ee701" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9" is_pre_election: true
I20260808 20:00:12.694319 23177 raft_consensus.cc:2468] T c75913753d95447783b9b7c7bb6ee701 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 0.
I20260808 20:00:12.695051 22607 leader_election.cc:304] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, 5f6b6c2e318d44a984120a06a09e9af9; no voters:
I20260808 20:00:12.695657 23561 raft_consensus.cc:2804] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:12.695786 23561 raft_consensus.cc:493] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:12.695896 23561 raft_consensus.cc:3060] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:12.699076 23561 raft_consensus.cc:515] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.700461 22941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75913753d95447783b9b7c7bb6ee701" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653"
I20260808 20:00:12.700716 22941 raft_consensus.cc:3060] T c75913753d95447783b9b7c7bb6ee701 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:12.704182 22941 raft_consensus.cc:2468] T c75913753d95447783b9b7c7bb6ee701 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 1.
I20260808 20:00:12.704950 22604 leader_election.cc:304] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:12.708353 23177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75913753d95447783b9b7c7bb6ee701" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9"
I20260808 20:00:12.708658 23177 raft_consensus.cc:3060] T c75913753d95447783b9b7c7bb6ee701 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:12.712006 23177 raft_consensus.cc:2468] T c75913753d95447783b9b7c7bb6ee701 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 1.
I20260808 20:00:12.717702 23561 leader_election.cc:290] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 election: Requested vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:12.718281 23880 raft_consensus.cc:2804] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:12.718694 23880 raft_consensus.cc:697] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 LEADER]: Becoming Leader. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Running, Role: LEADER
I20260808 20:00:12.720194 23880 consensus_queue.cc:237] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.724951 23520 raft_consensus.cc:493] T b8948ef8ed844727b9fed1e91d9233f6 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:12.725178 23520 raft_consensus.cc:515] T b8948ef8ed844727b9fed1e91d9233f6 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.725929 23520 leader_election.cc:290] T b8948ef8ed844727b9fed1e91d9233f6 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:12.727698 22711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8948ef8ed844727b9fed1e91d9233f6" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e" is_pre_election: true
I20260808 20:00:12.727989 22711 raft_consensus.cc:2468] T b8948ef8ed844727b9fed1e91d9233f6 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 0.
I20260808 20:00:12.728740 22831 leader_election.cc:304] T b8948ef8ed844727b9fed1e91d9233f6 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:12.729279 23520 raft_consensus.cc:2804] T b8948ef8ed844727b9fed1e91d9233f6 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:12.729390 23520 raft_consensus.cc:493] T b8948ef8ed844727b9fed1e91d9233f6 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:12.729491 23520 raft_consensus.cc:3060] T b8948ef8ed844727b9fed1e91d9233f6 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:12.731889 23177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8948ef8ed844727b9fed1e91d9233f6" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9" is_pre_election: true
I20260808 20:00:12.732168 23177 raft_consensus.cc:2468] T b8948ef8ed844727b9fed1e91d9233f6 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 0.
I20260808 20:00:12.734308 23520 raft_consensus.cc:515] T b8948ef8ed844727b9fed1e91d9233f6 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.735865 22711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8948ef8ed844727b9fed1e91d9233f6" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e"
I20260808 20:00:12.736126 22711 raft_consensus.cc:3060] T b8948ef8ed844727b9fed1e91d9233f6 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:12.736725 23177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8948ef8ed844727b9fed1e91d9233f6" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9"
I20260808 20:00:12.737007 23177 raft_consensus.cc:3060] T b8948ef8ed844727b9fed1e91d9233f6 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:12.739352 23520 leader_election.cc:290] T b8948ef8ed844727b9fed1e91d9233f6 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 election: Requested vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:12.739348 22711 raft_consensus.cc:2468] T b8948ef8ed844727b9fed1e91d9233f6 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 1.
I20260808 20:00:12.740010 22831 leader_election.cc:304] T b8948ef8ed844727b9fed1e91d9233f6 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:12.741797 23520 raft_consensus.cc:2804] T b8948ef8ed844727b9fed1e91d9233f6 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:12.742843 23520 raft_consensus.cc:697] T b8948ef8ed844727b9fed1e91d9233f6 P e34d5caee97d44fa945a91ddc6a54653 [term 1 LEADER]: Becoming Leader. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Running, Role: LEADER
I20260808 20:00:12.744694 23520 consensus_queue.cc:237] T b8948ef8ed844727b9fed1e91d9233f6 P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.746126 23177 raft_consensus.cc:2468] T b8948ef8ed844727b9fed1e91d9233f6 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 1.
I20260808 20:00:12.761940 22393 catalog_manager.cc:2757] deleted HMS catalog entry for table default.table_324c660111c84a72a6935eb8e30a7ae6 [id=06447c1e53ac4366baae14ef41588d7f]
I20260808 20:00:12.788277 23887 raft_consensus.cc:493] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:00:12.788815 23887 raft_consensus.cc:515] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:12.792441 22301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d2c4576401a74a60855647c956b195fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 71 } } ignore_live_leader: false dest_uuid: "16a59d796024414abf9f82a7593530a6" is_pre_election: true
I20260808 20:00:12.797396 22409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d2c4576401a74a60855647c956b195fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 71 } } ignore_live_leader: false dest_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" is_pre_election: true
I20260808 20:00:12.798345 23638 leader_election.cc:304] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2c4576401a74a60855647c956b195fd; no voters: 16a59d796024414abf9f82a7593530a6, b91a1a84d6cd4038ac9d3ad2b8cf7979
I20260808 20:00:12.804778 23887 leader_election.cc:290] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
I20260808 20:00:12.805469 23887 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260808 20:00:12.807672 22287 catalog_manager.cc:2210] deleted orphaned HMS catalog entry for table [id=bce1917a27c14330bfe2ccc5dc0b40a3]
I20260808 20:00:12.808223 22287 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:38088 (request call id 31) took 3527 ms. Trace:
I20260808 20:00:12.808368 22287 rpcz_store.cc:276] 0808 20:00:09.281127 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:10.437655 (+1156528us) service_pool.cc:224] Handling call
0808 20:00:12.022682 (+1585027us) catalog_manager.cc:2127] Acquired catalog manager lock
0808 20:00:12.023225 (+ 543us) catalog_manager.cc:2173] Created new table and tablet info
0808 20:00:12.176996 (+153771us) catalog_manager.cc:2199] Created new table in HMS catalog
0808 20:00:12.178042 (+ 1046us) write_op.cc:489] Releasing partition, row and schema locks
0808 20:00:12.178056 (+ 14us) write_op.cc:454] Released schema lock
0808 20:00:12.178414 (+ 358us) catalog_manager.cc:2207] Rolling back HMS table creation
0808 20:00:12.808169 (+629755us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0808 20:00:12.177829 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica 16a59d796024414abf9f82a7593530a6 is not leader of this config: current role FOLLOWER)
0808 20:00:12.177846 (+ 17us) write_op.cc:489] Releasing partition, row and schema locks
0808 20:00:12.177854 (+ 8us) write_op.cc:454] Released schema lock
0808 20:00:12.177882 (+ 28us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":445224,"Hive Metastore.run_cpu_time_us":555,"Hive Metastore.run_wall_time_us":336990,"child_traces":[["op",{}]]}
I20260808 20:00:12.826687 22390 catalog_manager.cc:2200] created HMS catalog entry for table [id=67d34c9d2f51445e8cf367f41abbcc28]
I20260808 20:00:12.886154 22288 catalog_manager.cc:2210] deleted orphaned HMS catalog entry for table [id=1ba38449531f437d8795f5e35a3f9479]
I20260808 20:00:12.886654 22288 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:38088 (request call id 30) took 3701 ms. Trace:
I20260808 20:00:12.886763 22288 rpcz_store.cc:276] 0808 20:00:09.185112 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:10.368915 (+1183803us) service_pool.cc:224] Handling call
0808 20:00:12.029601 (+1660686us) catalog_manager.cc:2127] Acquired catalog manager lock
0808 20:00:12.030167 (+ 566us) catalog_manager.cc:2173] Created new table and tablet info
0808 20:00:12.476628 (+446461us) catalog_manager.cc:2199] Created new table in HMS catalog
0808 20:00:12.477483 (+ 855us) write_op.cc:489] Releasing partition, row and schema locks
0808 20:00:12.477486 (+ 3us) write_op.cc:454] Released schema lock
0808 20:00:12.477755 (+ 269us) catalog_manager.cc:2207] Rolling back HMS table creation
0808 20:00:12.886581 (+408826us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0808 20:00:12.477389 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica 16a59d796024414abf9f82a7593530a6 is not leader of this config: current role FOLLOWER)
0808 20:00:12.477411 (+ 22us) write_op.cc:489] Releasing partition, row and schema locks
0808 20:00:12.477419 (+ 8us) write_op.cc:454] Released schema lock
0808 20:00:12.477424 (+ 5us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":664452,"Hive Metastore.run_cpu_time_us":648,"Hive Metastore.run_wall_time_us":188351,"child_traces":[["op",{}]]}
I20260808 20:00:12.895103 22394 catalog_manager.cc:2200] created HMS catalog entry for table [id=08230c16ec604c259195bbfa0c062164]
I20260808 20:00:12.906071 23254 heartbeater.cc:499] Master 127.21.36.124:34593 was elected leader, sending a full tablet report...
I20260808 20:00:12.921185 22901 tablet_service.cc:1511] Processing CreateTablet for tablet 57c91cdb20e74754b418cbc9af674632 (DEFAULT_TABLE table=default.table_42e6672ee7be4c4389fcc998d6eb322d [id=67d34c9d2f51445e8cf367f41abbcc28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:12.921741 22901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c91cdb20e74754b418cbc9af674632. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:12.923878 22674 tablet_service.cc:1511] Processing CreateTablet for tablet 57c91cdb20e74754b418cbc9af674632 (DEFAULT_TABLE table=default.table_42e6672ee7be4c4389fcc998d6eb322d [id=67d34c9d2f51445e8cf367f41abbcc28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:12.924425 22674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c91cdb20e74754b418cbc9af674632. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:12.928537 23136 tablet_service.cc:1511] Processing CreateTablet for tablet 57c91cdb20e74754b418cbc9af674632 (DEFAULT_TABLE table=default.table_42e6672ee7be4c4389fcc998d6eb322d [id=67d34c9d2f51445e8cf367f41abbcc28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:12.929021 23136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c91cdb20e74754b418cbc9af674632. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:12.935611 23838 tablet_bootstrap.cc:492] T 57c91cdb20e74754b418cbc9af674632 P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:12.937458 23838 tablet_bootstrap.cc:654] T 57c91cdb20e74754b418cbc9af674632 P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:12.942600 23833 tablet_bootstrap.cc:492] T 57c91cdb20e74754b418cbc9af674632 P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:12.944479 23833 tablet_bootstrap.cc:654] T 57c91cdb20e74754b418cbc9af674632 P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:12.947292 22394 catalog_manager.cc:5719] T 286e98ffe9b44ada92fd8e9776578df2 P 5f6b6c2e318d44a984120a06a09e9af9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67). New cstate: current_term: 1 leader_uuid: "5f6b6c2e318d44a984120a06a09e9af9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } health_report { overall_health: HEALTHY } } }
I20260808 20:00:12.948441 22394 catalog_manager.cc:5811] TS 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047) does not have the latest schema for tablet 553ff75afb1d47d9b48410b8d6fa13dc (table default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528]). Expected version 1 got 0
I20260808 20:00:12.949031 22394 catalog_manager.cc:5719] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67). New cstate: current_term: 1 leader_uuid: "5f6b6c2e318d44a984120a06a09e9af9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } health_report { overall_health: HEALTHY } } }
I20260808 20:00:12.949903 22394 catalog_manager.cc:5811] TS 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047) does not have the latest schema for tablet 0ef3105d34f447a592fd4de0d08f347f (table default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619]). Expected version 1 got 0
I20260808 20:00:12.951421 22676 tablet_service.cc:1511] Processing CreateTablet for tablet 746ad131d3534fedb10eef21b4bd23ee (DEFAULT_TABLE table=default.table_61bf42c8286347d197162895f70520d7 [id=08230c16ec604c259195bbfa0c062164]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:12.952024 22676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 746ad131d3534fedb10eef21b4bd23ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:12.954676 22901 tablet_service.cc:1511] Processing CreateTablet for tablet 746ad131d3534fedb10eef21b4bd23ee (DEFAULT_TABLE table=default.table_61bf42c8286347d197162895f70520d7 [id=08230c16ec604c259195bbfa0c062164]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:12.955175 22901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 746ad131d3534fedb10eef21b4bd23ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:12.959376 23838 tablet_bootstrap.cc:492] T 57c91cdb20e74754b418cbc9af674632 P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:12.959718 23838 ts_tablet_manager.cc:1403] T 57c91cdb20e74754b418cbc9af674632 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.001s
I20260808 20:00:12.960697 23838 raft_consensus.cc:359] T 57c91cdb20e74754b418cbc9af674632 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.965209 23833 tablet_bootstrap.cc:492] T 57c91cdb20e74754b418cbc9af674632 P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:12.965430 23833 ts_tablet_manager.cc:1403] T 57c91cdb20e74754b418cbc9af674632 P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.007s
I20260808 20:00:12.966493 23833 raft_consensus.cc:359] T 57c91cdb20e74754b418cbc9af674632 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.966737 23833 raft_consensus.cc:385] T 57c91cdb20e74754b418cbc9af674632 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:12.961419 23136 tablet_service.cc:1511] Processing CreateTablet for tablet 746ad131d3534fedb10eef21b4bd23ee (DEFAULT_TABLE table=default.table_61bf42c8286347d197162895f70520d7 [id=08230c16ec604c259195bbfa0c062164]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:12.966849 23833 raft_consensus.cc:740] T 57c91cdb20e74754b418cbc9af674632 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:12.967166 23833 consensus_queue.cc:260] T 57c91cdb20e74754b418cbc9af674632 P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.966650 23838 raft_consensus.cc:385] T 57c91cdb20e74754b418cbc9af674632 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:12.967831 23838 raft_consensus.cc:740] T 57c91cdb20e74754b418cbc9af674632 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:12.968402 23838 consensus_queue.cc:260] T 57c91cdb20e74754b418cbc9af674632 P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:12.967331 23136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 746ad131d3534fedb10eef21b4bd23ee. 1 dirs total, 0 dirs full, 0 dirs failed
W20260808 20:00:12.970868 22394 catalog_manager.cc:5911] Failed to send AlterTable RPC for tablet 553ff75afb1d47d9b48410b8d6fa13dc (table default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 553ff75afb1d47d9b48410b8d6fa13dc consensus state has no leader
I20260808 20:00:12.971873 22390 catalog_manager.cc:5811] TS 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923) does not have the latest schema for tablet 0ef3105d34f447a592fd4de0d08f347f (table default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619]). Expected version 1 got 0
I20260808 20:00:12.972396 22390 catalog_manager.cc:5811] TS 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923) does not have the latest schema for tablet 553ff75afb1d47d9b48410b8d6fa13dc (table default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528]). Expected version 1 got 0
I20260808 20:00:12.973783 23838 ts_tablet_manager.cc:1434] T 57c91cdb20e74754b418cbc9af674632 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260808 20:00:12.975821 22678 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e7bbbf891cd4500a8ec7f3d21905240 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 20:00:12 UTC) from {username='slave'} at 127.0.0.1:54424
I20260808 20:00:12.976931 23833 ts_tablet_manager.cc:1434] T 57c91cdb20e74754b418cbc9af674632 P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.011s user 0.002s sys 0.001s
W20260808 20:00:12.976989 22378 catalog_manager.cc:5017] TS 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): delete failed for tablet 4e7bbbf891cd4500a8ec7f3d21905240 because the tablet was not found. No further retry: Not found: Tablet not found: 4e7bbbf891cd4500a8ec7f3d21905240
I20260808 20:00:12.978820 22678 tablet_service.cc:1558] Processing DeleteTablet for tablet ab9fb2ba3d5c490a992e704eb4582c82 with delete_type TABLET_DATA_DELETED (replaced by tablet 553ff75afb1d47d9b48410b8d6fa13dc) from {username='slave'} at 127.0.0.1:54424
W20260808 20:00:12.981655 22378 catalog_manager.cc:5017] TS 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): delete failed for tablet ab9fb2ba3d5c490a992e704eb4582c82 because the tablet was not found. No further retry: Not found: Tablet not found: ab9fb2ba3d5c490a992e704eb4582c82
I20260808 20:00:12.982790 22941 raft_consensus.cc:1275] T 0ef3105d34f447a592fd4de0d08f347f P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Refusing update from remote peer 5f6b6c2e318d44a984120a06a09e9af9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 20:00:12.983919 22711 raft_consensus.cc:1275] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Refusing update from remote peer 5f6b6c2e318d44a984120a06a09e9af9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 20:00:12.984673 22388 catalog_manager.cc:2200] created HMS catalog entry for table [id=89520ebff12347f18df06b25577ecf63]
I20260808 20:00:12.985535 22678 tablet_service.cc:1558] Processing DeleteTablet for tablet d60be8ef6e8642388691bb0cd3ab2ada with delete_type TABLET_DATA_DELETED (replaced by tablet 0ef3105d34f447a592fd4de0d08f347f) from {username='slave'} at 127.0.0.1:54424
I20260808 20:00:12.989609 23845 consensus_queue.cc:1048] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:12.990145 23845 consensus_queue.cc:1048] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 20:00:12.991714 22378 catalog_manager.cc:5017] TS 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): delete failed for tablet d60be8ef6e8642388691bb0cd3ab2ada because the tablet was not found. No further retry: Not found: Tablet not found: d60be8ef6e8642388691bb0cd3ab2ada
I20260808 20:00:12.993194 22394 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55530:
table { table_name: "default.Table_3ffa098d41af4ebb987cec463feb8e76" } new_table_name: "default.Table_7e7179fca77a4eba85afe7296adac113" modify_external_catalogs: true
I20260808 20:00:12.994655 22678 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ceb53121b5247b7ac83292c4c2d5416 with delete_type TABLET_DATA_DELETED (replaced by tablet b8948ef8ed844727b9fed1e91d9233f6) from {username='slave'} at 127.0.0.1:54424
I20260808 20:00:12.995221 22390 catalog_manager.cc:5811] TS e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229) does not have the latest schema for tablet 553ff75afb1d47d9b48410b8d6fa13dc (table default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528]). Expected version 1 got 0
I20260808 20:00:12.995817 23842 tablet_bootstrap.cc:492] T 746ad131d3534fedb10eef21b4bd23ee P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:12.997709 23842 tablet_bootstrap.cc:654] T 746ad131d3534fedb10eef21b4bd23ee P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:12.997030 22388 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55530:
table { table_name: "default.Table_1cd24efa52a547cc872dd7ffe4938fb8" } new_table_name: "default.Table_eeef3b0a60b348b7b04564f853ad9db6" modify_external_catalogs: true
I20260808 20:00:13.001933 22390 catalog_manager.cc:5719] T b8948ef8ed844727b9fed1e91d9233f6 P e34d5caee97d44fa945a91ddc6a54653 reported cstate change: term changed from 0 to 1, leader changed from <none> to e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66). New cstate: current_term: 1 leader_uuid: "e34d5caee97d44fa945a91ddc6a54653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } health_report { overall_health: UNKNOWN } } }
W20260808 20:00:13.005282 22378 catalog_manager.cc:5017] TS 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): delete failed for tablet 6ceb53121b5247b7ac83292c4c2d5416 because the tablet was not found. No further retry: Not found: Tablet not found: 6ceb53121b5247b7ac83292c4c2d5416
I20260808 20:00:13.011126 22390 catalog_manager.cc:5811] TS e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229) does not have the latest schema for tablet 0ef3105d34f447a592fd4de0d08f347f (table default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619]). Expected version 1 got 0
I20260808 20:00:13.014627 23833 tablet_bootstrap.cc:492] T 746ad131d3534fedb10eef21b4bd23ee P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:13.016737 23833 tablet_bootstrap.cc:654] T 746ad131d3534fedb10eef21b4bd23ee P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
W20260808 20:00:13.029985 22379 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 553ff75afb1d47d9b48410b8d6fa13dc (table default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 553ff75afb1d47d9b48410b8d6fa13dc consensus state has no leader
I20260808 20:00:13.034669 22390 catalog_manager.cc:5811] TS 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923) does not have the latest schema for tablet 553ff75afb1d47d9b48410b8d6fa13dc (table default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528]). Expected version 1 got 0
I20260808 20:00:13.035203 22390 catalog_manager.cc:5811] TS 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923) does not have the latest schema for tablet 0ef3105d34f447a592fd4de0d08f347f (table default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619]). Expected version 1 got 0
I20260808 20:00:13.036427 23143 tablet_service.cc:1511] Processing CreateTablet for tablet 2523719318f84e31862e40d76f9a23f5 (DEFAULT_TABLE table=default.table_5a92fa3792a1443f94a707060264359c [id=89520ebff12347f18df06b25577ecf63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:13.037307 23143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2523719318f84e31862e40d76f9a23f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:13.037140 22906 tablet_service.cc:1511] Processing CreateTablet for tablet 2523719318f84e31862e40d76f9a23f5 (DEFAULT_TABLE table=default.table_5a92fa3792a1443f94a707060264359c [id=89520ebff12347f18df06b25577ecf63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:13.038365 22906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2523719318f84e31862e40d76f9a23f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:13.046020 23838 tablet_bootstrap.cc:492] T 746ad131d3534fedb10eef21b4bd23ee P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:13.035935 22390 catalog_manager.cc:5719] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65). New cstate: current_term: 1 leader_uuid: "257c9c7e0c6c441593eac06beb31fa4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } health_report { overall_health: UNKNOWN } } }
I20260808 20:00:13.047088 22674 tablet_service.cc:1511] Processing CreateTablet for tablet 2523719318f84e31862e40d76f9a23f5 (DEFAULT_TABLE table=default.table_5a92fa3792a1443f94a707060264359c [id=89520ebff12347f18df06b25577ecf63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:13.047798 22674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2523719318f84e31862e40d76f9a23f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:13.048096 23838 tablet_bootstrap.cc:654] T 746ad131d3534fedb10eef21b4bd23ee P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:13.061388 22390 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55530:
table { table_name: "default.Table_530ab728450b4272b3e9573534afe4e6" } new_table_name: "default.Table_924eca5df51c4cceb65228505a337698" modify_external_catalogs: true
I20260808 20:00:13.067807 23833 tablet_bootstrap.cc:492] T 746ad131d3534fedb10eef21b4bd23ee P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:13.068163 23833 ts_tablet_manager.cc:1403] T 746ad131d3534fedb10eef21b4bd23ee P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.054s user 0.003s sys 0.008s
I20260808 20:00:13.068398 23842 tablet_bootstrap.cc:492] T 746ad131d3534fedb10eef21b4bd23ee P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:13.068567 23842 ts_tablet_manager.cc:1403] T 746ad131d3534fedb10eef21b4bd23ee P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.073s user 0.003s sys 0.008s
I20260808 20:00:13.069423 23842 raft_consensus.cc:359] T 746ad131d3534fedb10eef21b4bd23ee P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:13.069659 23842 raft_consensus.cc:385] T 746ad131d3534fedb10eef21b4bd23ee P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:13.069751 23842 raft_consensus.cc:740] T 746ad131d3534fedb10eef21b4bd23ee P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:13.070034 23842 consensus_queue.cc:260] T 746ad131d3534fedb10eef21b4bd23ee P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:13.071440 23842 ts_tablet_manager.cc:1434] T 746ad131d3534fedb10eef21b4bd23ee P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260808 20:00:13.071803 23842 tablet_bootstrap.cc:492] T 57c91cdb20e74754b418cbc9af674632 P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:13.075874 23833 raft_consensus.cc:359] T 746ad131d3534fedb10eef21b4bd23ee P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:13.076237 23833 raft_consensus.cc:385] T 746ad131d3534fedb10eef21b4bd23ee P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:13.076385 23833 raft_consensus.cc:740] T 746ad131d3534fedb10eef21b4bd23ee P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:13.076781 23833 consensus_queue.cc:260] T 746ad131d3534fedb10eef21b4bd23ee P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:13.079527 23838 tablet_bootstrap.cc:492] T 746ad131d3534fedb10eef21b4bd23ee P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:13.079730 23838 ts_tablet_manager.cc:1403] T 746ad131d3534fedb10eef21b4bd23ee P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.034s user 0.005s sys 0.000s
I20260808 20:00:13.080569 23838 raft_consensus.cc:359] T 746ad131d3534fedb10eef21b4bd23ee P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:13.080785 23838 raft_consensus.cc:385] T 746ad131d3534fedb10eef21b4bd23ee P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:13.080861 23838 raft_consensus.cc:740] T 746ad131d3534fedb10eef21b4bd23ee P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:13.081187 23838 consensus_queue.cc:260] T 746ad131d3534fedb10eef21b4bd23ee P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:13.083416 23838 ts_tablet_manager.cc:1434] T 746ad131d3534fedb10eef21b4bd23ee P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260808 20:00:13.083448 23833 ts_tablet_manager.cc:1434] T 746ad131d3534fedb10eef21b4bd23ee P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.015s user 0.000s sys 0.002s
I20260808 20:00:13.083817 23838 tablet_bootstrap.cc:492] T 2523719318f84e31862e40d76f9a23f5 P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:13.086802 23833 tablet_bootstrap.cc:492] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:13.094494 23838 tablet_bootstrap.cc:654] T 2523719318f84e31862e40d76f9a23f5 P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:13.095331 23842 tablet_bootstrap.cc:654] T 57c91cdb20e74754b418cbc9af674632 P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:13.096036 23833 tablet_bootstrap.cc:654] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:13.100183 23916 tablet.cc:1724] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 20:00:13.107944 23922 tablet.cc:1724] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 20:00:13.109685 23833 tablet_bootstrap.cc:492] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:13.110004 23833 ts_tablet_manager.cc:1403] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.004s
I20260808 20:00:13.111580 23833 raft_consensus.cc:359] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.113014 23842 tablet_bootstrap.cc:492] T 57c91cdb20e74754b418cbc9af674632 P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:13.113302 23842 ts_tablet_manager.cc:1403] T 57c91cdb20e74754b418cbc9af674632 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.042s user 0.002s sys 0.002s
I20260808 20:00:13.114283 23842 raft_consensus.cc:359] T 57c91cdb20e74754b418cbc9af674632 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.114506 23842 raft_consensus.cc:385] T 57c91cdb20e74754b418cbc9af674632 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:13.114589 23842 raft_consensus.cc:740] T 57c91cdb20e74754b418cbc9af674632 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:13.117748 23833 raft_consensus.cc:385] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:13.120127 23833 raft_consensus.cc:740] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:13.110499 23925 tablet.cc:1724] T 0ef3105d34f447a592fd4de0d08f347f P e34d5caee97d44fa945a91ddc6a54653: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 20:00:13.123183 23833 consensus_queue.cc:260] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.124094 23842 consensus_queue.cc:260] T 57c91cdb20e74754b418cbc9af674632 P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.128185 23833 ts_tablet_manager.cc:1434] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260808 20:00:13.140626 23842 ts_tablet_manager.cc:1434] T 57c91cdb20e74754b418cbc9af674632 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.027s user 0.002s sys 0.001s
I20260808 20:00:13.141077 23842 tablet_bootstrap.cc:492] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:13.153656 23838 tablet_bootstrap.cc:492] T 2523719318f84e31862e40d76f9a23f5 P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:13.153854 23838 ts_tablet_manager.cc:1403] T 2523719318f84e31862e40d76f9a23f5 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.070s user 0.002s sys 0.002s
I20260808 20:00:13.154968 23838 raft_consensus.cc:359] T 2523719318f84e31862e40d76f9a23f5 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.155200 23838 raft_consensus.cc:385] T 2523719318f84e31862e40d76f9a23f5 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:13.155306 23838 raft_consensus.cc:740] T 2523719318f84e31862e40d76f9a23f5 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:13.155722 23838 consensus_queue.cc:260] T 2523719318f84e31862e40d76f9a23f5 P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.160050 23838 ts_tablet_manager.cc:1434] T 2523719318f84e31862e40d76f9a23f5 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260808 20:00:13.173811 23842 tablet_bootstrap.cc:654] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:13.179382 22387 catalog_manager.cc:2200] created HMS catalog entry for table [id=0145ea517a7a4aec99304181d1c6cb28]
I20260808 20:00:13.189579 22387 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:55530 (request call id 15) took 1070 ms. Trace:
I20260808 20:00:13.189774 22387 rpcz_store.cc:276] 0808 20:00:12.118918 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:12.118969 (+ 51us) service_pool.cc:224] Handling call
0808 20:00:12.234188 (+115219us) catalog_manager.cc:2127] Acquired catalog manager lock
0808 20:00:12.235191 (+ 1003us) catalog_manager.cc:2173] Created new table and tablet info
0808 20:00:13.179316 (+944125us) catalog_manager.cc:2199] Created new table in HMS catalog
0808 20:00:13.189271 (+ 9955us) catalog_manager.cc:2233] Wrote table and tablets to system table
0808 20:00:13.189405 (+ 134us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0808 20:00:13.189525 (+ 120us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0808 20:00:13.181118 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0808 20:00:13.181282 (+ 164us) write_op.cc:432] Acquiring schema lock in shared mode
0808 20:00:13.181292 (+ 10us) write_op.cc:435] Acquired schema lock
0808 20:00:13.181294 (+ 2us) tablet.cc:662] Decoding operations
0808 20:00:13.181404 (+ 110us) write_op.cc:620] Acquiring the partition lock for write op
0808 20:00:13.181420 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0808 20:00:13.181425 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0808 20:00:13.181535 (+ 110us) tablet.cc:701] Row locks acquired
0808 20:00:13.181537 (+ 2us) write_op.cc:260] PREPARE: finished
0808 20:00:13.181591 (+ 54us) write_op.cc:270] Start()
0808 20:00:13.181632 (+ 41us) write_op.cc:276] Timestamp: P: 1786219213181541 usec, L: 0
0808 20:00:13.181636 (+ 4us) op_driver.cc:348] REPLICATION: starting
0808 20:00:13.181875 (+ 239us) log.cc:844] Serialized 432 byte log entry
0808 20:00:13.187721 (+ 5846us) op_driver.cc:464] REPLICATION: finished
0808 20:00:13.187852 (+ 131us) write_op.cc:301] APPLY: starting
0808 20:00:13.187874 (+ 22us) tablet.cc:1367] starting BulkCheckPresence
0808 20:00:13.187926 (+ 52us) tablet.cc:1370] finished BulkCheckPresence
0808 20:00:13.187970 (+ 44us) tablet.cc:1372] starting ApplyRowOperation cycle
0808 20:00:13.188109 (+ 139us) tablet.cc:1383] finished ApplyRowOperation cycle
0808 20:00:13.188151 (+ 42us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0808 20:00:13.188159 (+ 8us) write_op.cc:312] APPLY: finished
0808 20:00:13.188258 (+ 99us) log.cc:844] Serialized 28 byte log entry
0808 20:00:13.188332 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0808 20:00:13.188357 (+ 25us) write_op.cc:454] Released schema lock
0808 20:00:13.188365 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0808 20:00:13.188442 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0808 20:00:13.188446 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":747986,"Hive Metastore.run_cpu_time_us":309,"Hive Metastore.run_wall_time_us":194588,"child_traces":[["op",{"apply.queue_time_us":72,"apply.run_cpu_time_us":579,"apply.run_wall_time_us":579,"num_ops":2,"prepare.queue_time_us":786,"prepare.run_cpu_time_us":930,"prepare.run_wall_time_us":931,"raft.queue_time_us":1433,"raft.run_cpu_time_us":811,"raft.run_wall_time_us":3935,"replication_time_us":6045}]]}
I20260808 20:00:13.195045 22387 catalog_manager.cc:5811] TS 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923) does not have the latest schema for tablet 0ef3105d34f447a592fd4de0d08f347f (table default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619]). Expected version 1 got 0
I20260808 20:00:13.212054 22674 tablet_service.cc:1511] Processing CreateTablet for tablet 3c66d42b171948bba3f76c598b60e858 (DEFAULT_TABLE table=default.table_f7a6e8903ed74dc088eb1f490788c54b [id=0145ea517a7a4aec99304181d1c6cb28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:13.212605 22674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c66d42b171948bba3f76c598b60e858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:13.212759 23136 tablet_service.cc:1511] Processing CreateTablet for tablet 3c66d42b171948bba3f76c598b60e858 (DEFAULT_TABLE table=default.table_f7a6e8903ed74dc088eb1f490788c54b [id=0145ea517a7a4aec99304181d1c6cb28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:13.213253 23136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c66d42b171948bba3f76c598b60e858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:13.213614 22906 tablet_service.cc:1511] Processing CreateTablet for tablet 3c66d42b171948bba3f76c598b60e858 (DEFAULT_TABLE table=default.table_f7a6e8903ed74dc088eb1f490788c54b [id=0145ea517a7a4aec99304181d1c6cb28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:13.214044 22906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c66d42b171948bba3f76c598b60e858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:13.215695 23878 raft_consensus.cc:493] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:13.215879 23878 raft_consensus.cc:515] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.216761 23878 leader_election.cc:290] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:13.218004 22941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "553ff75afb1d47d9b48410b8d6fa13dc" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653" is_pre_election: true
I20260808 20:00:13.218305 22941 raft_consensus.cc:2468] T 553ff75afb1d47d9b48410b8d6fa13dc P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 0.
I20260808 20:00:13.219208 22711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "553ff75afb1d47d9b48410b8d6fa13dc" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e" is_pre_election: true
I20260808 20:00:13.219264 23066 leader_election.cc:304] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:13.219494 22711 raft_consensus.cc:2468] T 553ff75afb1d47d9b48410b8d6fa13dc P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 0.
I20260808 20:00:13.219666 23878 raft_consensus.cc:2804] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:13.219799 23878 raft_consensus.cc:493] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:13.219898 23878 raft_consensus.cc:3060] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:13.220815 23833 tablet_bootstrap.cc:492] T 3c66d42b171948bba3f76c598b60e858 P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:13.222826 23833 tablet_bootstrap.cc:654] T 3c66d42b171948bba3f76c598b60e858 P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:13.222895 23878 raft_consensus.cc:515] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.230357 22711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "553ff75afb1d47d9b48410b8d6fa13dc" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e"
I20260808 20:00:13.230645 22711 raft_consensus.cc:3060] T 553ff75afb1d47d9b48410b8d6fa13dc P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:13.231001 22941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "553ff75afb1d47d9b48410b8d6fa13dc" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653"
I20260808 20:00:13.231256 22941 raft_consensus.cc:3060] T 553ff75afb1d47d9b48410b8d6fa13dc P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:13.233863 22711 raft_consensus.cc:2468] T 553ff75afb1d47d9b48410b8d6fa13dc P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 1.
I20260808 20:00:13.234535 23066 leader_election.cc:304] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, 5f6b6c2e318d44a984120a06a09e9af9; no voters:
I20260808 20:00:13.234774 22941 raft_consensus.cc:2468] T 553ff75afb1d47d9b48410b8d6fa13dc P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 1.
I20260808 20:00:13.234929 23845 raft_consensus.cc:2804] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:13.235090 23845 raft_consensus.cc:697] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 LEADER]: Becoming Leader. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Running, Role: LEADER
I20260808 20:00:13.235421 23845 consensus_queue.cc:237] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.242266 22282 catalog_manager.cc:2210] deleted orphaned HMS catalog entry for table [id=95d1dc4138bd491da51e09440dab7eee]
I20260808 20:00:13.242739 22282 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:38088 (request call id 33) took 3858 ms. Trace:
I20260808 20:00:13.242890 22282 rpcz_store.cc:276] 0808 20:00:09.384441 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:11.169873 (+1785432us) service_pool.cc:224] Handling call
0808 20:00:12.030525 (+860652us) catalog_manager.cc:2127] Acquired catalog manager lock
0808 20:00:12.035832 (+ 5307us) catalog_manager.cc:2173] Created new table and tablet info
0808 20:00:12.623572 (+587740us) catalog_manager.cc:2199] Created new table in HMS catalog
0808 20:00:12.624580 (+ 1008us) write_op.cc:489] Releasing partition, row and schema locks
0808 20:00:12.624584 (+ 4us) write_op.cc:454] Released schema lock
0808 20:00:12.624838 (+ 254us) catalog_manager.cc:2207] Rolling back HMS table creation
0808 20:00:13.242681 (+617843us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0808 20:00:12.624497 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica 16a59d796024414abf9f82a7593530a6 is not leader of this config: current role FOLLOWER)
0808 20:00:12.624510 (+ 13us) write_op.cc:489] Releasing partition, row and schema locks
0808 20:00:12.624519 (+ 9us) write_op.cc:454] Released schema lock
0808 20:00:12.624523 (+ 4us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":699269,"Hive Metastore.run_cpu_time_us":602,"Hive Metastore.run_wall_time_us":502676,"child_traces":[["op",{}]]}
W20260808 20:00:13.244158 23273 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.21.36.124:34593)
I20260808 20:00:13.257262 22387 catalog_manager.cc:5811] TS e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229) does not have the latest schema for tablet 0ef3105d34f447a592fd4de0d08f347f (table default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619]). Expected version 1 got 0
I20260808 20:00:13.263121 23878 leader_election.cc:290] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 election: Requested vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:13.267163 23838 tablet_bootstrap.cc:492] T 3c66d42b171948bba3f76c598b60e858 P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:13.269299 23838 tablet_bootstrap.cc:654] T 3c66d42b171948bba3f76c598b60e858 P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:13.280586 23838 tablet_bootstrap.cc:492] T 3c66d42b171948bba3f76c598b60e858 P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:13.280824 23838 ts_tablet_manager.cc:1403] T 3c66d42b171948bba3f76c598b60e858 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.001s
I20260808 20:00:13.281764 23838 raft_consensus.cc:359] T 3c66d42b171948bba3f76c598b60e858 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.282007 23838 raft_consensus.cc:385] T 3c66d42b171948bba3f76c598b60e858 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:13.282104 23838 raft_consensus.cc:740] T 3c66d42b171948bba3f76c598b60e858 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:13.282400 23838 consensus_queue.cc:260] T 3c66d42b171948bba3f76c598b60e858 P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.286103 23838 ts_tablet_manager.cc:1434] T 3c66d42b171948bba3f76c598b60e858 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260808 20:00:13.290817 23842 tablet_bootstrap.cc:492] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:13.291014 23842 ts_tablet_manager.cc:1403] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.150s user 0.002s sys 0.002s
I20260808 20:00:13.291954 23842 raft_consensus.cc:359] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.292171 23842 raft_consensus.cc:385] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:13.292264 23842 raft_consensus.cc:740] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:13.292572 23842 consensus_queue.cc:260] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.293185 23842 ts_tablet_manager.cc:1434] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260808 20:00:13.293526 23842 tablet_bootstrap.cc:492] T 3c66d42b171948bba3f76c598b60e858 P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:13.298979 22387 catalog_manager.cc:5719] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67). New cstate: current_term: 1 leader_uuid: "5f6b6c2e318d44a984120a06a09e9af9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } health_report { overall_health: HEALTHY } } }
I20260808 20:00:13.299523 22387 catalog_manager.cc:5811] TS 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047) does not have the latest schema for tablet 553ff75afb1d47d9b48410b8d6fa13dc (table default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528]). Expected version 1 got 0
I20260808 20:00:13.306634 23842 tablet_bootstrap.cc:654] T 3c66d42b171948bba3f76c598b60e858 P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:13.309083 23833 tablet_bootstrap.cc:492] T 3c66d42b171948bba3f76c598b60e858 P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:13.309408 23833 ts_tablet_manager.cc:1403] T 3c66d42b171948bba3f76c598b60e858 P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.089s user 0.020s sys 0.024s
I20260808 20:00:13.310344 23833 raft_consensus.cc:359] T 3c66d42b171948bba3f76c598b60e858 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.310652 23833 raft_consensus.cc:385] T 3c66d42b171948bba3f76c598b60e858 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:13.310793 23833 raft_consensus.cc:740] T 3c66d42b171948bba3f76c598b60e858 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:13.311165 23833 consensus_queue.cc:260] T 3c66d42b171948bba3f76c598b60e858 P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.315608 23833 ts_tablet_manager.cc:1434] T 3c66d42b171948bba3f76c598b60e858 P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260808 20:00:13.320914 22396 catalog_manager.cc:2200] created HMS catalog entry for table [id=edaf172891fe4dafbc1b00bbb27d9c1c]
I20260808 20:00:13.338866 22387 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55530:
table { table_name: "default.Table_732a1b16caff489aa844bba46e6ec1cb" } new_table_name: "default.Table_ff8fd7fa6c944c55bf82a9babe8329b9" modify_external_catalogs: true
I20260808 20:00:13.345935 22396 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:55530 (request call id 14) took 1227 ms. Trace:
I20260808 20:00:13.346089 22396 rpcz_store.cc:276] 0808 20:00:12.118563 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:12.118628 (+ 65us) service_pool.cc:224] Handling call
0808 20:00:12.233974 (+115346us) catalog_manager.cc:2127] Acquired catalog manager lock
0808 20:00:12.236763 (+ 2789us) catalog_manager.cc:2173] Created new table and tablet info
0808 20:00:13.320871 (+1084108us) catalog_manager.cc:2199] Created new table in HMS catalog
0808 20:00:13.345581 (+ 24710us) catalog_manager.cc:2233] Wrote table and tablets to system table
0808 20:00:13.345731 (+ 150us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0808 20:00:13.345854 (+ 123us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0808 20:00:13.321744 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0808 20:00:13.321871 (+ 127us) write_op.cc:432] Acquiring schema lock in shared mode
0808 20:00:13.321878 (+ 7us) write_op.cc:435] Acquired schema lock
0808 20:00:13.321881 (+ 3us) tablet.cc:662] Decoding operations
0808 20:00:13.321990 (+ 109us) write_op.cc:620] Acquiring the partition lock for write op
0808 20:00:13.322005 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0808 20:00:13.322009 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0808 20:00:13.322108 (+ 99us) tablet.cc:701] Row locks acquired
0808 20:00:13.322110 (+ 2us) write_op.cc:260] PREPARE: finished
0808 20:00:13.322151 (+ 41us) write_op.cc:270] Start()
0808 20:00:13.322188 (+ 37us) write_op.cc:276] Timestamp: P: 1786219213322092 usec, L: 0
0808 20:00:13.322191 (+ 3us) op_driver.cc:348] REPLICATION: starting
0808 20:00:13.322397 (+ 206us) log.cc:844] Serialized 432 byte log entry
0808 20:00:13.344724 (+ 22327us) op_driver.cc:464] REPLICATION: finished
0808 20:00:13.344829 (+ 105us) write_op.cc:301] APPLY: starting
0808 20:00:13.344851 (+ 22us) tablet.cc:1367] starting BulkCheckPresence
0808 20:00:13.344902 (+ 51us) tablet.cc:1370] finished BulkCheckPresence
0808 20:00:13.344928 (+ 26us) tablet.cc:1372] starting ApplyRowOperation cycle
0808 20:00:13.345212 (+ 284us) tablet.cc:1383] finished ApplyRowOperation cycle
0808 20:00:13.345252 (+ 40us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0808 20:00:13.345259 (+ 7us) write_op.cc:312] APPLY: finished
0808 20:00:13.345356 (+ 97us) log.cc:844] Serialized 28 byte log entry
0808 20:00:13.345435 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0808 20:00:13.345473 (+ 38us) write_op.cc:454] Released schema lock
0808 20:00:13.345482 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0808 20:00:13.345563 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0808 20:00:13.345567 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":942161,"Hive Metastore.run_cpu_time_us":304,"Hive Metastore.run_wall_time_us":141542,"child_traces":[["op",{"apply.queue_time_us":38,"apply.run_cpu_time_us":726,"apply.run_wall_time_us":726,"num_ops":2,"prepare.queue_time_us":110,"prepare.run_cpu_time_us":738,"prepare.run_wall_time_us":739,"replication_time_us":22494}]]}
I20260808 20:00:13.351814 22941 raft_consensus.cc:1275] T 553ff75afb1d47d9b48410b8d6fa13dc P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Refusing update from remote peer 5f6b6c2e318d44a984120a06a09e9af9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 20:00:13.352681 22711 raft_consensus.cc:1275] T 553ff75afb1d47d9b48410b8d6fa13dc P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Refusing update from remote peer 5f6b6c2e318d44a984120a06a09e9af9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 20:00:13.353761 23845 consensus_queue.cc:1048] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:13.354353 23845 consensus_queue.cc:1048] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:13.375833 23136 tablet_service.cc:1511] Processing CreateTablet for tablet 9b63e4c056f34242aacef5ffafb14b25 (DEFAULT_TABLE table=default.table_ba9e157aaf3a487eb4f3f2ec9c37b761 [id=edaf172891fe4dafbc1b00bbb27d9c1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:13.375988 22906 tablet_service.cc:1511] Processing CreateTablet for tablet 9b63e4c056f34242aacef5ffafb14b25 (DEFAULT_TABLE table=default.table_ba9e157aaf3a487eb4f3f2ec9c37b761 [id=edaf172891fe4dafbc1b00bbb27d9c1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:13.376462 22906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b63e4c056f34242aacef5ffafb14b25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:13.376483 23136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b63e4c056f34242aacef5ffafb14b25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:13.380247 22674 tablet_service.cc:1511] Processing CreateTablet for tablet 9b63e4c056f34242aacef5ffafb14b25 (DEFAULT_TABLE table=default.table_ba9e157aaf3a487eb4f3f2ec9c37b761 [id=edaf172891fe4dafbc1b00bbb27d9c1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:13.380726 22674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b63e4c056f34242aacef5ffafb14b25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:13.387365 22396 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55530:
table { table_name: "default.Table_4ed5029dcfbd499db24fb72e6b389d42" } new_table_name: "default.Table_a9d94ade99394dc6b742a534c91da3bd" modify_external_catalogs: true
I20260808 20:00:13.387861 23884 raft_consensus.cc:493] T 3c66d42b171948bba3f76c598b60e858 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:13.388031 23884 raft_consensus.cc:515] T 3c66d42b171948bba3f76c598b60e858 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.388805 23884 leader_election.cc:290] T 3c66d42b171948bba3f76c598b60e858 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:13.389809 22710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c66d42b171948bba3f76c598b60e858" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e" is_pre_election: true
I20260808 20:00:13.390426 23177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c66d42b171948bba3f76c598b60e858" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9" is_pre_election: true
W20260808 20:00:13.390637 22831 leader_election.cc:343] T 3c66d42b171948bba3f76c598b60e858 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Illegal state: must be running to vote when last-logged opid is not known
I20260808 20:00:13.390695 23177 raft_consensus.cc:2468] T 3c66d42b171948bba3f76c598b60e858 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 0.
I20260808 20:00:13.391196 22835 leader_election.cc:304] T 3c66d42b171948bba3f76c598b60e858 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653; no voters: 257c9c7e0c6c441593eac06beb31fa4e
I20260808 20:00:13.391669 23884 raft_consensus.cc:2804] T 3c66d42b171948bba3f76c598b60e858 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:13.391789 23884 raft_consensus.cc:493] T 3c66d42b171948bba3f76c598b60e858 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:13.391881 23884 raft_consensus.cc:3060] T 3c66d42b171948bba3f76c598b60e858 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:13.397156 23884 raft_consensus.cc:515] T 3c66d42b171948bba3f76c598b60e858 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.398541 22710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c66d42b171948bba3f76c598b60e858" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e"
I20260808 20:00:13.398661 23884 leader_election.cc:290] T 3c66d42b171948bba3f76c598b60e858 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 election: Requested vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:00:13.399309 22831 leader_election.cc:343] T 3c66d42b171948bba3f76c598b60e858 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Illegal state: must be running to vote when last-logged opid is not known
I20260808 20:00:13.399981 23177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c66d42b171948bba3f76c598b60e858" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9"
I20260808 20:00:13.400235 23177 raft_consensus.cc:3060] T 3c66d42b171948bba3f76c598b60e858 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:13.403627 23177 raft_consensus.cc:2468] T 3c66d42b171948bba3f76c598b60e858 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 1.
I20260808 20:00:13.404381 22835 leader_election.cc:304] T 3c66d42b171948bba3f76c598b60e858 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653; no voters: 257c9c7e0c6c441593eac06beb31fa4e
I20260808 20:00:13.406558 23884 raft_consensus.cc:2804] T 3c66d42b171948bba3f76c598b60e858 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:13.414426 23838 tablet_bootstrap.cc:492] T 9b63e4c056f34242aacef5ffafb14b25 P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:13.416514 23838 tablet_bootstrap.cc:654] T 9b63e4c056f34242aacef5ffafb14b25 P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:13.419183 23833 tablet_bootstrap.cc:492] T 9b63e4c056f34242aacef5ffafb14b25 P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:13.421205 23833 tablet_bootstrap.cc:654] T 9b63e4c056f34242aacef5ffafb14b25 P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:13.426923 22397 catalog_manager.cc:2200] created HMS catalog entry for table [id=fb4aaf09a463481d9f5512884b9574d7]
I20260808 20:00:13.430563 23838 tablet_bootstrap.cc:492] T 9b63e4c056f34242aacef5ffafb14b25 P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:13.430755 23838 ts_tablet_manager.cc:1403] T 9b63e4c056f34242aacef5ffafb14b25 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.010s
I20260808 20:00:13.431742 23838 raft_consensus.cc:359] T 9b63e4c056f34242aacef5ffafb14b25 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.431964 23838 raft_consensus.cc:385] T 9b63e4c056f34242aacef5ffafb14b25 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:13.432082 23838 raft_consensus.cc:740] T 9b63e4c056f34242aacef5ffafb14b25 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:13.432340 23838 consensus_queue.cc:260] T 9b63e4c056f34242aacef5ffafb14b25 P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.433130 23838 ts_tablet_manager.cc:1434] T 9b63e4c056f34242aacef5ffafb14b25 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 20:00:13.438237 22397 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:55530 (request call id 3) took 1378 ms. Trace:
I20260808 20:00:13.438402 22397 rpcz_store.cc:276] 0808 20:00:12.059913 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 20:00:12.059992 (+ 79us) service_pool.cc:224] Handling call
0808 20:00:12.229007 (+169015us) catalog_manager.cc:2127] Acquired catalog manager lock
0808 20:00:12.236993 (+ 7986us) catalog_manager.cc:2173] Created new table and tablet info
0808 20:00:13.426879 (+1189886us) catalog_manager.cc:2199] Created new table in HMS catalog
0808 20:00:13.437910 (+ 11031us) catalog_manager.cc:2233] Wrote table and tablets to system table
0808 20:00:13.438031 (+ 121us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0808 20:00:13.438160 (+ 129us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0808 20:00:13.427966 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0808 20:00:13.428106 (+ 140us) write_op.cc:432] Acquiring schema lock in shared mode
0808 20:00:13.428136 (+ 30us) write_op.cc:435] Acquired schema lock
0808 20:00:13.428138 (+ 2us) tablet.cc:662] Decoding operations
0808 20:00:13.428246 (+ 108us) write_op.cc:620] Acquiring the partition lock for write op
0808 20:00:13.428262 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0808 20:00:13.428268 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0808 20:00:13.428363 (+ 95us) tablet.cc:701] Row locks acquired
0808 20:00:13.428365 (+ 2us) write_op.cc:260] PREPARE: finished
0808 20:00:13.428414 (+ 49us) write_op.cc:270] Start()
0808 20:00:13.428474 (+ 60us) write_op.cc:276] Timestamp: P: 1786219213428396 usec, L: 0
0808 20:00:13.428479 (+ 5us) op_driver.cc:348] REPLICATION: starting
0808 20:00:13.428719 (+ 240us) log.cc:844] Serialized 432 byte log entry
0808 20:00:13.436807 (+ 8088us) op_driver.cc:464] REPLICATION: finished
0808 20:00:13.436930 (+ 123us) write_op.cc:301] APPLY: starting
0808 20:00:13.436950 (+ 20us) tablet.cc:1367] starting BulkCheckPresence
0808 20:00:13.437002 (+ 52us) tablet.cc:1370] finished BulkCheckPresence
0808 20:00:13.437040 (+ 38us) tablet.cc:1372] starting ApplyRowOperation cycle
0808 20:00:13.437165 (+ 125us) tablet.cc:1383] finished ApplyRowOperation cycle
0808 20:00:13.437205 (+ 40us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0808 20:00:13.437212 (+ 7us) write_op.cc:312] APPLY: finished
0808 20:00:13.437322 (+ 110us) log.cc:844] Serialized 28 byte log entry
0808 20:00:13.437404 (+ 82us) write_op.cc:489] Releasing partition, row and schema locks
0808 20:00:13.437430 (+ 26us) write_op.cc:454] Released schema lock
0808 20:00:13.437439 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0808 20:00:13.437529 (+ 90us) write_op.cc:489] Releasing partition, row and schema locks
0808 20:00:13.437533 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1083564,"Hive Metastore.run_cpu_time_us":316,"Hive Metastore.run_wall_time_us":106002,"spinlock_wait_cycles":3456,"child_traces":[["op",{"apply.queue_time_us":65,"apply.run_cpu_time_us":584,"apply.run_wall_time_us":584,"num_ops":2,"prepare.queue_time_us":72,"prepare.run_cpu_time_us":888,"prepare.run_wall_time_us":888,"raft.queue_time_us":1609,"raft.run_cpu_time_us":845,"raft.run_wall_time_us":845,"replication_time_us":8284}]]}
I20260808 20:00:13.441020 22397 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55530:
table { table_name: "default.Table_c083bd43fffa4344b41de48e5edd3fd3" } modify_external_catalogs: true
I20260808 20:00:13.441233 22397 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55530:
table { table_name: "default.Table_c083bd43fffa4344b41de48e5edd3fd3" } modify_external_catalogs: true
F20260808 20:00:13.446887 22487 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 27, previous 27; dumping first 8 out of 15 received events: NotificationEvent(eventId=21, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_831d17f2742e4fb8bc727d56fc9d1c85, message={"server":"","servicePrincipal":"","db":"default","table":"table_831d17f2742e4fb8bc727d56fc9d1c85","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_831d17f2742e4fb8bc727d56fc9d1c85\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219209},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_831d17f2742e4fb8bc727d56fc9d1c85\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_831d17f2742e4fb8bc727d56fc9d1c85\",\"kudu.table_id\":\"b47087e2cd6349b1ba2b8daf55b2d1d5\",\"transient_lastDdlTime\":\"1786219209\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=22, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_752d0310c94b42d3902fffa1070bb1d4, message={"server":"","servicePrincipal":"","db":"default","table":"table_752d0310c94b42d3902fffa1070bb1d4","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_752d0310c94b42d3902fffa1070bb1d4\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219209},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_752d0310c94b42d3902fffa1070bb1d4\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_752d0310c94b42d3902fffa1070bb1d4\",\"kudu.table_id\":\"3b10ed2d37fe46a5b63d646901474c8e\",\"transient_lastDdlTime\":\"1786219209\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1786219212, eventType=CREATE_TABLE, dbName=default, tableName=table_aa0809b208774982934a9f8de43aecf5, message={"server":"","servicePrincipal":"","db":"default","table":"table_aa0809b208774982934a9f8de43aecf5","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_aa0809b208774982934a9f8de43aecf5\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219212},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_aa0809b208774982934a9f8de43aecf5\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_aa0809b208774982934a9f8de43aecf5\",\"kudu.table_id\":\"1ba38449531f437d8795f5e35a3f9479\",\"transient_lastDdlTime\":\"1786219212\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=24, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_4dc166b247ee4cf89cdd926e07b51a51, message={"server":"","servicePrincipal":"","db":"default","table":"table_4dc166b247ee4cf89cdd926e07b51a51","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_4dc166b247ee4cf89cdd926e07b51a51\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219210},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_4dc166b247ee4cf89cdd926e07b51a51\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_4dc166b247ee4cf89cdd926e07b51a51\",\"kudu.table_id\":\"355ea74a32ec4502b6679611e8c8b67e\",\"transient_lastDdlTime\":\"1786219210\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=25, eventTime=1786219212, eventType=CREATE_TABLE, dbName=default, tableName=table_bfc21652528345b883ecf7962d128fee, message={"server":"","servicePrincipal":"","db":"default","table":"table_bfc21652528345b883ecf7962d128fee","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_bfc21652528345b883ecf7962d128fee\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219212},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_bfc21652528345b883ecf7962d128fee\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_bfc21652528345b883ecf7962d128fee\",\"kudu.table_id\":\"95d1dc4138bd491da51e09440dab7eee\",\"transient_lastDdlTime\":\"1786219212\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=26, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_324c660111c84a72a6935eb8e30a7ae6, message={"server":"","servicePrincipal":"","db":"default","table":"table_324c660111c84a72a6935eb8e30a7ae6","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_324c660111c84a72a6935eb8e30a7ae6\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219209},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_324c660111c84a72a6935eb8e30a7ae6\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_324c660111c84a72a6935eb8e30a7ae6\",\"kudu.table_id\":\"06447c1e53ac4366baae14ef41588d7f\",\"transient_lastDdlTime\":\"1786219209\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=27, eventTime=1786219212, eventType=CREATE_TABLE, dbName=default, tableName=table_42e6672ee7be4c4389fcc998d6eb322d, message={"server":"","servicePrincipal":"","db":"default","table":"table_42e6672ee7be4c4389fcc998d6eb322d","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_42e6672ee7be4c4389fcc998d6eb322d\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219212},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_42e6672ee7be4c4389fcc998d6eb322d\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_42e6672ee7be4c4389fcc998d6eb322d\",\"kudu.table_id\":\"67d34c9d2f51445e8cf367f41abbcc28\",\"transient_lastDdlTime\":\"1786219212\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=27, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_5730907850e643b4ac068a85e1574ddf, message={"server":"","servicePrincipal":"","db":"default","table":"table_5730907850e643b4ac068a85e1574ddf","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_5730907850e643b4ac068a85e1574ddf\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219212},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_5730907850e643b4ac068a85e1574ddf\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_5730907850e643b4ac068a85e1574ddf\",\"kudu.table_id\":\"bce1917a27c14330bfe2ccc5dc0b40a3\",\"transient_lastDdlTime\":\"1786219212\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
I20260808 20:00:13.447896 23833 tablet_bootstrap.cc:492] T 9b63e4c056f34242aacef5ffafb14b25 P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:13.448079 23833 ts_tablet_manager.cc:1403] T 9b63e4c056f34242aacef5ffafb14b25 P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.029s user 0.009s sys 0.000s
I20260808 20:00:13.448927 23833 raft_consensus.cc:359] T 9b63e4c056f34242aacef5ffafb14b25 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.449148 23833 raft_consensus.cc:385] T 9b63e4c056f34242aacef5ffafb14b25 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:13.449231 23833 raft_consensus.cc:740] T 9b63e4c056f34242aacef5ffafb14b25 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:13.449484 23833 consensus_queue.cc:260] T 9b63e4c056f34242aacef5ffafb14b25 P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
@ 0x7f97cbfd5d5d google::LogMessage::Fail() at ??:0
@ 0x7f97cbfd9b23 google::LogMessage::SendToLog() at ??:0
@ 0x7f97cbfd575c google::LogMessage::Flush() at ??:0
I20260808 20:00:13.459436 23833 ts_tablet_manager.cc:1434] T 9b63e4c056f34242aacef5ffafb14b25 P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.011s user 0.004s sys 0.000s
I20260808 20:00:13.474013 22906 tablet_service.cc:1511] Processing CreateTablet for tablet 2086c55bb74a4997bcc9a49205ecf0f5 (DEFAULT_TABLE table=default.table_01314a1f924d4e33bdecf8797a6e2e0a [id=fb4aaf09a463481d9f5512884b9574d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:13.474531 22906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2086c55bb74a4997bcc9a49205ecf0f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:13.478209 22674 tablet_service.cc:1511] Processing CreateTablet for tablet 2086c55bb74a4997bcc9a49205ecf0f5 (DEFAULT_TABLE table=default.table_01314a1f924d4e33bdecf8797a6e2e0a [id=fb4aaf09a463481d9f5512884b9574d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:13.478704 22674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2086c55bb74a4997bcc9a49205ecf0f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:13.483567 23833 tablet_bootstrap.cc:492] T 2086c55bb74a4997bcc9a49205ecf0f5 P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:13.485533 23833 tablet_bootstrap.cc:654] T 2086c55bb74a4997bcc9a49205ecf0f5 P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:13.486901 23143 tablet_service.cc:1511] Processing CreateTablet for tablet 2086c55bb74a4997bcc9a49205ecf0f5 (DEFAULT_TABLE table=default.table_01314a1f924d4e33bdecf8797a6e2e0a [id=fb4aaf09a463481d9f5512884b9574d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:13.487439 23143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2086c55bb74a4997bcc9a49205ecf0f5. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f97cbfd59a1 google::LogMessage::~LogMessage() at ??:0
I20260808 20:00:13.493363 23884 raft_consensus.cc:697] T 3c66d42b171948bba3f76c598b60e858 P e34d5caee97d44fa945a91ddc6a54653 [term 1 LEADER]: Becoming Leader. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Running, Role: LEADER
I20260808 20:00:13.493728 23884 consensus_queue.cc:237] T 3c66d42b171948bba3f76c598b60e858 P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.495139 23838 tablet_bootstrap.cc:492] T 2086c55bb74a4997bcc9a49205ecf0f5 P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:13.497102 23838 tablet_bootstrap.cc:654] T 2086c55bb74a4997bcc9a49205ecf0f5 P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:13.508584 23916 tablet.cc:1724] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 20:00:13.512714 23561 consensus_queue.cc:1048] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:13.516359 23925 tablet.cc:1724] T 553ff75afb1d47d9b48410b8d6fa13dc P e34d5caee97d44fa945a91ddc6a54653: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 20:00:13.516562 23867 mvcc.cc:204] Tried to move back new op lower bound from 7316353897882357760 to 7316353897416904704. Current Snapshot: MvccSnapshot[applied={T|T < 7316353897882357760}]
I20260808 20:00:13.518407 23838 tablet_bootstrap.cc:492] T 2086c55bb74a4997bcc9a49205ecf0f5 P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:13.518607 23838 ts_tablet_manager.cc:1403] T 2086c55bb74a4997bcc9a49205ecf0f5 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.009s
I20260808 20:00:13.519519 23838 raft_consensus.cc:359] T 2086c55bb74a4997bcc9a49205ecf0f5 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.520211 23838 raft_consensus.cc:385] T 2086c55bb74a4997bcc9a49205ecf0f5 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:13.520296 23838 raft_consensus.cc:740] T 2086c55bb74a4997bcc9a49205ecf0f5 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:13.520632 23838 consensus_queue.cc:260] T 2086c55bb74a4997bcc9a49205ecf0f5 P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.521194 23833 tablet_bootstrap.cc:492] T 2086c55bb74a4997bcc9a49205ecf0f5 P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:13.521317 23838 ts_tablet_manager.cc:1434] T 2086c55bb74a4997bcc9a49205ecf0f5 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 20:00:13.521382 23833 ts_tablet_manager.cc:1403] T 2086c55bb74a4997bcc9a49205ecf0f5 P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.038s user 0.005s sys 0.003s
I20260808 20:00:13.522262 23833 raft_consensus.cc:359] T 2086c55bb74a4997bcc9a49205ecf0f5 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.522475 23833 raft_consensus.cc:385] T 2086c55bb74a4997bcc9a49205ecf0f5 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:13.522540 23833 raft_consensus.cc:740] T 2086c55bb74a4997bcc9a49205ecf0f5 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:13.522800 23833 consensus_queue.cc:260] T 2086c55bb74a4997bcc9a49205ecf0f5 P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.523509 23833 ts_tablet_manager.cc:1434] T 2086c55bb74a4997bcc9a49205ecf0f5 P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260808 20:00:13.527011 23922 tablet.cc:1724] T 553ff75afb1d47d9b48410b8d6fa13dc P 257c9c7e0c6c441593eac06beb31fa4e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 20:00:13.533968 23948 consensus_queue.cc:1048] T b8948ef8ed844727b9fed1e91d9233f6 P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:13.545235 23842 tablet_bootstrap.cc:492] T 3c66d42b171948bba3f76c598b60e858 P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:13.545431 23842 ts_tablet_manager.cc:1403] T 3c66d42b171948bba3f76c598b60e858 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.252s user 0.037s sys 0.081s
I20260808 20:00:13.546347 23842 raft_consensus.cc:359] T 3c66d42b171948bba3f76c598b60e858 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.546558 23842 raft_consensus.cc:385] T 3c66d42b171948bba3f76c598b60e858 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:13.546625 23842 raft_consensus.cc:740] T 3c66d42b171948bba3f76c598b60e858 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:13.546911 23842 consensus_queue.cc:260] T 3c66d42b171948bba3f76c598b60e858 P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.547640 23842 ts_tablet_manager.cc:1434] T 3c66d42b171948bba3f76c598b60e858 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260808 20:00:13.548079 23842 tablet_bootstrap.cc:492] T 9b63e4c056f34242aacef5ffafb14b25 P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:13.550107 23842 tablet_bootstrap.cc:654] T 9b63e4c056f34242aacef5ffafb14b25 P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:13.568908 23842 tablet_bootstrap.cc:492] T 9b63e4c056f34242aacef5ffafb14b25 P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:13.569100 23842 ts_tablet_manager.cc:1403] T 9b63e4c056f34242aacef5ffafb14b25 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.021s user 0.015s sys 0.004s
I20260808 20:00:13.570003 23842 raft_consensus.cc:359] T 9b63e4c056f34242aacef5ffafb14b25 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.570204 23842 raft_consensus.cc:385] T 9b63e4c056f34242aacef5ffafb14b25 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:13.570305 23842 raft_consensus.cc:740] T 9b63e4c056f34242aacef5ffafb14b25 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:13.570609 23842 consensus_queue.cc:260] T 9b63e4c056f34242aacef5ffafb14b25 P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.571214 23842 ts_tablet_manager.cc:1434] T 9b63e4c056f34242aacef5ffafb14b25 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260808 20:00:13.573630 23842 tablet_bootstrap.cc:492] T 2086c55bb74a4997bcc9a49205ecf0f5 P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:13.575671 23842 tablet_bootstrap.cc:654] T 2086c55bb74a4997bcc9a49205ecf0f5 P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:13.586812 23842 tablet_bootstrap.cc:492] T 2086c55bb74a4997bcc9a49205ecf0f5 P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:13.587015 23842 ts_tablet_manager.cc:1403] T 2086c55bb74a4997bcc9a49205ecf0f5 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.005s
I20260808 20:00:13.593850 23967 raft_consensus.cc:493] T 746ad131d3534fedb10eef21b4bd23ee P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:13.594053 23967 raft_consensus.cc:515] T 746ad131d3534fedb10eef21b4bd23ee P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:13.595391 23177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746ad131d3534fedb10eef21b4bd23ee" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9" is_pre_election: true
I20260808 20:00:13.595661 23177 raft_consensus.cc:2468] T 746ad131d3534fedb10eef21b4bd23ee P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 0.
I20260808 20:00:13.596194 22835 leader_election.cc:304] T 746ad131d3534fedb10eef21b4bd23ee P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:13.560176 23948 consensus_queue.cc:1048] T b8948ef8ed844727b9fed1e91d9233f6 P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:13.600356 23948 raft_consensus.cc:493] T 9b63e4c056f34242aacef5ffafb14b25 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:13.600507 23948 raft_consensus.cc:515] T 9b63e4c056f34242aacef5ffafb14b25 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.601246 23948 leader_election.cc:290] T 9b63e4c056f34242aacef5ffafb14b25 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:13.601438 23948 raft_consensus.cc:2804] T 746ad131d3534fedb10eef21b4bd23ee P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:13.601528 23948 raft_consensus.cc:493] T 746ad131d3534fedb10eef21b4bd23ee P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:13.601603 23948 raft_consensus.cc:3060] T 746ad131d3534fedb10eef21b4bd23ee P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
W20260808 20:00:13.602510 22831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.36.65:39923, user_credentials={real_user=slave}} blocked reactor thread for 43616.6us
I20260808 20:00:13.604316 23842 raft_consensus.cc:359] T 2086c55bb74a4997bcc9a49205ecf0f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.604565 23842 raft_consensus.cc:385] T 2086c55bb74a4997bcc9a49205ecf0f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:13.604658 23842 raft_consensus.cc:740] T 2086c55bb74a4997bcc9a49205ecf0f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:13.604916 23842 consensus_queue.cc:260] T 2086c55bb74a4997bcc9a49205ecf0f5 P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.605595 23842 ts_tablet_manager.cc:1434] T 2086c55bb74a4997bcc9a49205ecf0f5 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.018s user 0.001s sys 0.002s
I20260808 20:00:13.608752 22710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b63e4c056f34242aacef5ffafb14b25" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e" is_pre_election: true
I20260808 20:00:13.609011 22710 raft_consensus.cc:2468] T 9b63e4c056f34242aacef5ffafb14b25 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 0.
I20260808 20:00:13.613677 22831 leader_election.cc:304] T 9b63e4c056f34242aacef5ffafb14b25 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:13.616155 23965 raft_consensus.cc:2804] T 9b63e4c056f34242aacef5ffafb14b25 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:13.616277 23965 raft_consensus.cc:493] T 9b63e4c056f34242aacef5ffafb14b25 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:13.616396 23965 raft_consensus.cc:3060] T 9b63e4c056f34242aacef5ffafb14b25 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:13.623855 22710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746ad131d3534fedb10eef21b4bd23ee" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e" is_pre_election: true
I20260808 20:00:13.624159 22710 raft_consensus.cc:2468] T 746ad131d3534fedb10eef21b4bd23ee P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 0.
I20260808 20:00:13.619678 23967 leader_election.cc:290] T 746ad131d3534fedb10eef21b4bd23ee P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923)
@ 0x7f97e2c9ef64 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260808 20:00:13.632149 23176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b63e4c056f34242aacef5ffafb14b25" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9" is_pre_election: true
I20260808 20:00:13.632423 23176 raft_consensus.cc:2468] T 9b63e4c056f34242aacef5ffafb14b25 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 0.
I20260808 20:00:13.634299 23969 consensus_queue.cc:1048] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
@ 0x7f97e2c9d811 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7f97e2ca548c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7f97e2ca5309 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaaf86d std::function<>::operator()() at ??:?
I20260808 20:00:13.668642 23948 raft_consensus.cc:515] T 746ad131d3534fedb10eef21b4bd23ee P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:13.669406 23948 leader_election.cc:290] T 746ad131d3534fedb10eef21b4bd23ee P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 election: Requested vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923)
I20260808 20:00:13.669691 23965 raft_consensus.cc:515] T 9b63e4c056f34242aacef5ffafb14b25 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.669934 23177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746ad131d3534fedb10eef21b4bd23ee" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9"
I20260808 20:00:13.670135 23177 raft_consensus.cc:3060] T 746ad131d3534fedb10eef21b4bd23ee P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:13.670367 23965 leader_election.cc:290] T 9b63e4c056f34242aacef5ffafb14b25 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 election: Requested vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:13.670826 23176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b63e4c056f34242aacef5ffafb14b25" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9"
I20260808 20:00:13.671007 23176 raft_consensus.cc:3060] T 9b63e4c056f34242aacef5ffafb14b25 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
@ 0x7f97cecfddd9 kudu::Thread::SuperviseThread() at ??:0
I20260808 20:00:13.673964 23176 raft_consensus.cc:2468] T 9b63e4c056f34242aacef5ffafb14b25 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 1.
I20260808 20:00:13.674572 22835 leader_election.cc:304] T 9b63e4c056f34242aacef5ffafb14b25 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653; no voters:
@ 0x7f97d23cd6db start_thread at ??:0
I20260808 20:00:13.674865 23948 raft_consensus.cc:493] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:13.675004 23948 raft_consensus.cc:515] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.675676 23948 leader_election.cc:290] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:13.675841 23948 raft_consensus.cc:2804] T 9b63e4c056f34242aacef5ffafb14b25 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:13.675982 23948 raft_consensus.cc:697] T 9b63e4c056f34242aacef5ffafb14b25 P e34d5caee97d44fa945a91ddc6a54653 [term 1 LEADER]: Becoming Leader. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Running, Role: LEADER
@ 0x7f97cae8461f clone at ??:0
I20260808 20:00:13.676239 23948 consensus_queue.cc:237] T 9b63e4c056f34242aacef5ffafb14b25 P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.677860 23176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2523719318f84e31862e40d76f9a23f5" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9" is_pre_election: true
I20260808 20:00:13.678133 23176 raft_consensus.cc:2468] T 2523719318f84e31862e40d76f9a23f5 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 0.
I20260808 20:00:13.678705 22835 leader_election.cc:304] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:13.679085 23965 raft_consensus.cc:2804] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:13.679193 23965 raft_consensus.cc:493] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:13.679272 23965 raft_consensus.cc:3060] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:13.680645 23177 raft_consensus.cc:2468] T 746ad131d3534fedb10eef21b4bd23ee P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 1.
I20260808 20:00:13.681200 22835 leader_election.cc:304] T 746ad131d3534fedb10eef21b4bd23ee P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:13.681807 23972 raft_consensus.cc:2804] T 746ad131d3534fedb10eef21b4bd23ee P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:13.681945 23972 raft_consensus.cc:697] T 746ad131d3534fedb10eef21b4bd23ee P e34d5caee97d44fa945a91ddc6a54653 [term 1 LEADER]: Becoming Leader. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Running, Role: LEADER
I20260808 20:00:13.682195 22711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b63e4c056f34242aacef5ffafb14b25" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e"
I20260808 20:00:13.682446 22711 raft_consensus.cc:3060] T 9b63e4c056f34242aacef5ffafb14b25 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:13.682377 23972 consensus_queue.cc:237] T 746ad131d3534fedb10eef21b4bd23ee P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:13.682538 22710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "746ad131d3534fedb10eef21b4bd23ee" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e"
I20260808 20:00:13.682729 22710 raft_consensus.cc:3060] T 746ad131d3534fedb10eef21b4bd23ee P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:13.683710 22706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2523719318f84e31862e40d76f9a23f5" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e" is_pre_election: true
I20260808 20:00:13.683983 22706 raft_consensus.cc:2468] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 0.
I20260808 20:00:13.685920 22711 raft_consensus.cc:2468] T 9b63e4c056f34242aacef5ffafb14b25 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 1.
I20260808 20:00:13.686523 22710 raft_consensus.cc:2468] T 746ad131d3534fedb10eef21b4bd23ee P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 1.
I20260808 20:00:13.690275 23965 raft_consensus.cc:515] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.692027 23176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2523719318f84e31862e40d76f9a23f5" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9"
I20260808 20:00:13.692242 23176 raft_consensus.cc:3060] T 2523719318f84e31862e40d76f9a23f5 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:13.695319 23176 raft_consensus.cc:2468] T 2523719318f84e31862e40d76f9a23f5 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 1.
I20260808 20:00:13.699581 22835 leader_election.cc:304] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:13.699991 23952 raft_consensus.cc:2804] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:13.700230 23952 raft_consensus.cc:697] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653 [term 1 LEADER]: Becoming Leader. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Running, Role: LEADER
I20260808 20:00:13.700587 23952 consensus_queue.cc:237] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.703624 23965 leader_election.cc:290] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 election: Requested vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:13.706565 22710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2523719318f84e31862e40d76f9a23f5" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e"
I20260808 20:00:13.706866 22710 raft_consensus.cc:3060] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:13.709993 22710 raft_consensus.cc:2468] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 1.
I20260808 20:00:13.720733 23969 raft_consensus.cc:493] T 2086c55bb74a4997bcc9a49205ecf0f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:13.720952 23969 raft_consensus.cc:515] T 2086c55bb74a4997bcc9a49205ecf0f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.721719 23969 leader_election.cc:290] T 2086c55bb74a4997bcc9a49205ecf0f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:13.724592 22941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2086c55bb74a4997bcc9a49205ecf0f5" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653" is_pre_election: true
I20260808 20:00:13.724726 23177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2086c55bb74a4997bcc9a49205ecf0f5" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9" is_pre_election: true
I20260808 20:00:13.724822 22941 raft_consensus.cc:2468] T 2086c55bb74a4997bcc9a49205ecf0f5 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 0.
I20260808 20:00:13.724960 23177 raft_consensus.cc:2468] T 2086c55bb74a4997bcc9a49205ecf0f5 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 0.
I20260808 20:00:13.725335 22604 leader_election.cc:304] T 2086c55bb74a4997bcc9a49205ecf0f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:13.725816 23969 raft_consensus.cc:2804] T 2086c55bb74a4997bcc9a49205ecf0f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:13.725916 23969 raft_consensus.cc:493] T 2086c55bb74a4997bcc9a49205ecf0f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:13.726011 23969 raft_consensus.cc:3060] T 2086c55bb74a4997bcc9a49205ecf0f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:13.729092 23969 raft_consensus.cc:515] T 2086c55bb74a4997bcc9a49205ecf0f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.730356 23969 leader_election.cc:290] T 2086c55bb74a4997bcc9a49205ecf0f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 election: Requested vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:13.731123 23177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2086c55bb74a4997bcc9a49205ecf0f5" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9"
I20260808 20:00:13.731196 22941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2086c55bb74a4997bcc9a49205ecf0f5" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653"
I20260808 20:00:13.731312 23177 raft_consensus.cc:3060] T 2086c55bb74a4997bcc9a49205ecf0f5 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:13.731415 22941 raft_consensus.cc:3060] T 2086c55bb74a4997bcc9a49205ecf0f5 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:13.733466 23177 raft_consensus.cc:2468] T 2086c55bb74a4997bcc9a49205ecf0f5 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 1.
I20260808 20:00:13.734025 22607 leader_election.cc:304] T 2086c55bb74a4997bcc9a49205ecf0f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, 5f6b6c2e318d44a984120a06a09e9af9; no voters:
I20260808 20:00:13.734545 22941 raft_consensus.cc:2468] T 2086c55bb74a4997bcc9a49205ecf0f5 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 1.
I20260808 20:00:13.735266 23969 raft_consensus.cc:2804] T 2086c55bb74a4997bcc9a49205ecf0f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:13.735919 23969 raft_consensus.cc:697] T 2086c55bb74a4997bcc9a49205ecf0f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 LEADER]: Becoming Leader. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Running, Role: LEADER
I20260808 20:00:13.736212 23969 consensus_queue.cc:237] T 2086c55bb74a4997bcc9a49205ecf0f5 P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.895659 23878 raft_consensus.cc:493] T 57c91cdb20e74754b418cbc9af674632 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:13.895893 23878 raft_consensus.cc:515] T 57c91cdb20e74754b418cbc9af674632 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.896622 23878 leader_election.cc:290] T 57c91cdb20e74754b418cbc9af674632 P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:13.897399 22941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c91cdb20e74754b418cbc9af674632" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653" is_pre_election: true
I20260808 20:00:13.897400 22710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c91cdb20e74754b418cbc9af674632" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e" is_pre_election: true
I20260808 20:00:13.897641 22941 raft_consensus.cc:2468] T 57c91cdb20e74754b418cbc9af674632 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 0.
I20260808 20:00:13.897770 22710 raft_consensus.cc:2468] T 57c91cdb20e74754b418cbc9af674632 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 0.
I20260808 20:00:13.898128 23066 leader_election.cc:304] T 57c91cdb20e74754b418cbc9af674632 P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:13.898419 23878 raft_consensus.cc:2804] T 57c91cdb20e74754b418cbc9af674632 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:13.898545 23878 raft_consensus.cc:493] T 57c91cdb20e74754b418cbc9af674632 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:13.898639 23878 raft_consensus.cc:3060] T 57c91cdb20e74754b418cbc9af674632 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:13.900722 23878 raft_consensus.cc:515] T 57c91cdb20e74754b418cbc9af674632 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.901314 23878 leader_election.cc:290] T 57c91cdb20e74754b418cbc9af674632 P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 election: Requested vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:00:13.902696 23274 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.21.36.124:34593)
W20260808 20:00:13.902957 23274 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.21.36.124:34593)
I20260808 20:00:13.903160 22941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c91cdb20e74754b418cbc9af674632" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653"
I20260808 20:00:13.903402 22941 raft_consensus.cc:3060] T 57c91cdb20e74754b418cbc9af674632 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
W20260808 20:00:13.904819 23274 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.21.36.124:34593)
I20260808 20:00:13.906745 22941 raft_consensus.cc:2468] T 57c91cdb20e74754b418cbc9af674632 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 1.
I20260808 20:00:13.907603 23066 leader_election.cc:304] T 57c91cdb20e74754b418cbc9af674632 P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:13.907859 22710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c91cdb20e74754b418cbc9af674632" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e"
I20260808 20:00:13.908407 22710 raft_consensus.cc:3060] T 57c91cdb20e74754b418cbc9af674632 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:13.909301 23846 raft_consensus.cc:2804] T 57c91cdb20e74754b418cbc9af674632 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:13.909482 23846 raft_consensus.cc:697] T 57c91cdb20e74754b418cbc9af674632 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 LEADER]: Becoming Leader. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Running, Role: LEADER
I20260808 20:00:13.909803 23846 consensus_queue.cc:237] T 57c91cdb20e74754b418cbc9af674632 P 5f6b6c2e318d44a984120a06a09e9af9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:13.914127 22710 raft_consensus.cc:2468] T 57c91cdb20e74754b418cbc9af674632 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 1.
W20260808 20:00:13.918694 24002 negotiation.cc:336] Failed RPC negotiation. Trace:
0808 20:00:13.904359 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.21.36.124:34593 (local address 127.21.36.66:58165)
0808 20:00:13.917340 (+ 12981us) negotiation.cc:107] Waiting for socket to connect
0808 20:00:13.917526 (+ 186us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":12845,"threads_started":1}
W20260808 20:00:13.922178 24000 negotiation.cc:336] Failed RPC negotiation. Trace:
0808 20:00:13.902488 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.21.36.124:34593 (local address 127.21.36.67:35309)
0808 20:00:13.920893 (+ 18405us) negotiation.cc:107] Waiting for socket to connect
0808 20:00:13.921085 (+ 192us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":18304,"thread_start_us":18155,"threads_started":1}
W20260808 20:00:13.923883 24004 negotiation.cc:336] Failed RPC negotiation. Trace:
0808 20:00:13.904397 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.21.36.124:34593 (local address 127.21.36.65:56127)
0808 20:00:13.922796 (+ 18399us) negotiation.cc:107] Waiting for socket to connect
0808 20:00:13.922952 (+ 156us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":18252,"thread_start_us":18033,"threads_started":1}
I20260808 20:00:13.981395 24010 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:00:13.981633 24010 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:13.982412 24010 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
I20260808 20:00:13.983172 23691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "16a59d796024414abf9f82a7593530a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 87 } } ignore_live_leader: false dest_uuid: "d2c4576401a74a60855647c956b195fd" is_pre_election: true
W20260808 20:00:13.985894 22267 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:00:13.986088 22267 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:00:13.986400 24010 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260808 20:00:13.986797 24014 raft_consensus.cc:493] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:00:13.986953 24014 raft_consensus.cc:515] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:13.987720 24014 leader_election.cc:290] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
I20260808 20:00:13.988149 22302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d2c4576401a74a60855647c956b195fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 87 } } ignore_live_leader: false dest_uuid: "16a59d796024414abf9f82a7593530a6" is_pre_election: true
I20260808 20:00:13.988394 22302 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2c4576401a74a60855647c956b195fd in term 3.
W20260808 20:00:13.988734 23638 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:00:13.988919 23615 leader_election.cc:304] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16a59d796024414abf9f82a7593530a6, d2c4576401a74a60855647c956b195fd; no voters:
I20260808 20:00:13.989241 24014 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260808 20:00:13.989383 24014 raft_consensus.cc:493] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 3 FOLLOWER]: Starting leader election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:00:13.989501 24014 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 3 FOLLOWER]: Advancing to term 4
W20260808 20:00:13.990801 23638 leader_election.cc:336] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:00:13.992106 24014 raft_consensus.cc:515] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:13.992684 24014 leader_election.cc:290] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 4 election: Requested vote from peers 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
I20260808 20:00:13.993220 22302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d2c4576401a74a60855647c956b195fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 87 } } ignore_live_leader: false dest_uuid: "16a59d796024414abf9f82a7593530a6"
I20260808 20:00:13.993414 22302 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 3 FOLLOWER]: Advancing to term 4
W20260808 20:00:13.993999 23638 leader_election.cc:336] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:00:13.996155 22302 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2c4576401a74a60855647c956b195fd in term 4.
I20260808 20:00:13.996667 23615 leader_election.cc:304] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16a59d796024414abf9f82a7593530a6, d2c4576401a74a60855647c956b195fd; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979
I20260808 20:00:13.996981 24014 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 4 FOLLOWER]: Leader election won for term 4
I20260808 20:00:13.997498 24014 raft_consensus.cc:697] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 4 LEADER]: Becoming Leader. State: Replica: d2c4576401a74a60855647c956b195fd, State: Running, Role: LEADER
I20260808 20:00:13.997943 24014 consensus_queue.cc:237] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 87, Committed index: 87, Last appended: 3.87, Last appended by leader: 87, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:13.999526 24020 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2c4576401a74a60855647c956b195fd. Latest consensus state: current_term: 4 leader_uuid: "d2c4576401a74a60855647c956b195fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:13.999850 24020 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: This master's current role is: LEADER
I20260808 20:00:14.000554 24021 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 20:00:14.003376 24021 catalog_manager.cc:679] Loaded metadata for table default.table_f7a6e8903ed74dc088eb1f490788c54b [id=0145ea517a7a4aec99304181d1c6cb28]
I20260808 20:00:14.003897 24021 catalog_manager.cc:679] Loaded metadata for table default.table_324c660111c84a72a6935eb8e30a7ae6 [id=06447c1e53ac4366baae14ef41588d7f]
I20260808 20:00:14.004245 24021 catalog_manager.cc:679] Loaded metadata for table default.table_61bf42c8286347d197162895f70520d7 [id=08230c16ec604c259195bbfa0c062164]
I20260808 20:00:14.004550 24021 catalog_manager.cc:679] Loaded metadata for table default.table_3ffa098d41af4ebb987cec463feb8e76 [id=1042ec7801c740c09255102bf01b8fd2]
I20260808 20:00:14.004828 24021 catalog_manager.cc:679] Loaded metadata for table default.table_4dc166b247ee4cf89cdd926e07b51a51 [id=355ea74a32ec4502b6679611e8c8b67e]
I20260808 20:00:14.005347 24021 catalog_manager.cc:679] Loaded metadata for table default.table_752d0310c94b42d3902fffa1070bb1d4 [id=3b10ed2d37fe46a5b63d646901474c8e]
I20260808 20:00:14.005697 24021 catalog_manager.cc:679] Loaded metadata for table default.table_4ed5029dcfbd499db24fb72e6b389d42 [id=43498092c52a457d93f97ba0993e6012]
I20260808 20:00:14.006042 24021 catalog_manager.cc:679] Loaded metadata for table default.table_732a1b16caff489aa844bba46e6ec1cb [id=524bfe483c7f4c4d99d2757ff290c5eb]
I20260808 20:00:14.006377 24021 catalog_manager.cc:679] Loaded metadata for table default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528]
I20260808 20:00:14.006721 24021 catalog_manager.cc:679] Loaded metadata for table default.table_42e6672ee7be4c4389fcc998d6eb322d [id=67d34c9d2f51445e8cf367f41abbcc28]
I20260808 20:00:14.007047 24021 catalog_manager.cc:679] Loaded metadata for table default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619]
I20260808 20:00:14.007387 24021 catalog_manager.cc:679] Loaded metadata for table default.table_1cd24efa52a547cc872dd7ffe4938fb8 [id=87fca666b411494c8486baf1bfa58327]
I20260808 20:00:14.007748 24021 catalog_manager.cc:679] Loaded metadata for table default.table_5a92fa3792a1443f94a707060264359c [id=89520ebff12347f18df06b25577ecf63]
I20260808 20:00:14.008088 24021 catalog_manager.cc:679] Loaded metadata for table default.table_530ab728450b4272b3e9573534afe4e6 [id=8c917809771f4262811b9f200ff0e925]
I20260808 20:00:14.008428 24021 catalog_manager.cc:679] Loaded metadata for table default.table_583f1fdac11148488799008b032f7ef2 [id=99b11a3c5ca3411b8c1800c70f61597a]
I20260808 20:00:14.008760 24021 catalog_manager.cc:679] Loaded metadata for table default.table_831d17f2742e4fb8bc727d56fc9d1c85 [id=b47087e2cd6349b1ba2b8daf55b2d1d5]
I20260808 20:00:14.009090 24021 catalog_manager.cc:679] Loaded metadata for table default.table_ba9e157aaf3a487eb4f3f2ec9c37b761 [id=edaf172891fe4dafbc1b00bbb27d9c1c]
I20260808 20:00:14.009424 24021 catalog_manager.cc:679] Loaded metadata for table default.table_01314a1f924d4e33bdecf8797a6e2e0a [id=fb4aaf09a463481d9f5512884b9574d7]
I20260808 20:00:14.012252 24021 tablet_loader.cc:96] loaded metadata for tablet 0ef3105d34f447a592fd4de0d08f347f (table default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619])
I20260808 20:00:14.013196 24021 tablet_loader.cc:96] loaded metadata for tablet 2086c55bb74a4997bcc9a49205ecf0f5 (table default.table_01314a1f924d4e33bdecf8797a6e2e0a [id=fb4aaf09a463481d9f5512884b9574d7])
I20260808 20:00:14.013586 24021 tablet_loader.cc:96] loaded metadata for tablet 2523719318f84e31862e40d76f9a23f5 (table default.table_5a92fa3792a1443f94a707060264359c [id=89520ebff12347f18df06b25577ecf63])
I20260808 20:00:14.013860 24021 tablet_loader.cc:96] loaded metadata for tablet 286e98ffe9b44ada92fd8e9776578df2 (table default.table_732a1b16caff489aa844bba46e6ec1cb [id=524bfe483c7f4c4d99d2757ff290c5eb])
I20260808 20:00:14.014349 24021 tablet_loader.cc:96] loaded metadata for tablet 3c66d42b171948bba3f76c598b60e858 (table default.table_f7a6e8903ed74dc088eb1f490788c54b [id=0145ea517a7a4aec99304181d1c6cb28])
I20260808 20:00:14.014817 24021 tablet_loader.cc:96] loaded metadata for tablet 553ff75afb1d47d9b48410b8d6fa13dc (table default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528])
I20260808 20:00:14.015111 24021 tablet_loader.cc:96] loaded metadata for tablet 55cf64ca16df4afbae5f58843f613f27 (table default.table_530ab728450b4272b3e9573534afe4e6 [id=8c917809771f4262811b9f200ff0e925])
I20260808 20:00:14.015405 24021 tablet_loader.cc:96] loaded metadata for tablet 57c91cdb20e74754b418cbc9af674632 (table default.table_42e6672ee7be4c4389fcc998d6eb322d [id=67d34c9d2f51445e8cf367f41abbcc28])
I20260808 20:00:14.015898 24021 tablet_loader.cc:96] loaded metadata for tablet 7117a3852b424a2d83a00b4ebab727cf (table default.table_1cd24efa52a547cc872dd7ffe4938fb8 [id=87fca666b411494c8486baf1bfa58327])
I20260808 20:00:14.016196 24021 tablet_loader.cc:96] loaded metadata for tablet 746ad131d3534fedb10eef21b4bd23ee (table default.table_61bf42c8286347d197162895f70520d7 [id=08230c16ec604c259195bbfa0c062164])
I20260808 20:00:14.016484 24021 tablet_loader.cc:96] loaded metadata for tablet 78ab65d40a004ef9888b6577716b783c (table default.table_583f1fdac11148488799008b032f7ef2 [id=99b11a3c5ca3411b8c1800c70f61597a])
I20260808 20:00:14.016947 24021 tablet_loader.cc:96] loaded metadata for tablet 96627957fadb4a0a8d9f69159d48cdf8 (table default.table_4dc166b247ee4cf89cdd926e07b51a51 [id=355ea74a32ec4502b6679611e8c8b67e])
I20260808 20:00:14.017290 24021 tablet_loader.cc:96] loaded metadata for tablet 9b63e4c056f34242aacef5ffafb14b25 (table default.table_ba9e157aaf3a487eb4f3f2ec9c37b761 [id=edaf172891fe4dafbc1b00bbb27d9c1c])
I20260808 20:00:14.017962 24021 tablet_loader.cc:96] loaded metadata for tablet b45729e2ec9e4a77b8be89f9657b0424 (table default.table_4ed5029dcfbd499db24fb72e6b389d42 [id=43498092c52a457d93f97ba0993e6012])
I20260808 20:00:14.018249 24021 tablet_loader.cc:96] loaded metadata for tablet b8948ef8ed844727b9fed1e91d9233f6 (table default.table_324c660111c84a72a6935eb8e30a7ae6 [id=06447c1e53ac4366baae14ef41588d7f])
I20260808 20:00:14.018553 24021 tablet_loader.cc:96] loaded metadata for tablet c75913753d95447783b9b7c7bb6ee701 (table default.table_752d0310c94b42d3902fffa1070bb1d4 [id=3b10ed2d37fe46a5b63d646901474c8e])
I20260808 20:00:14.018831 24021 tablet_loader.cc:96] loaded metadata for tablet d1c720d7dc8e4b8184ffc863a22cf9e3 (table default.table_831d17f2742e4fb8bc727d56fc9d1c85 [id=b47087e2cd6349b1ba2b8daf55b2d1d5])
I20260808 20:00:14.019796 24021 tablet_loader.cc:96] loaded metadata for tablet e18581438df6444e98c94b958a31650c (table default.table_3ffa098d41af4ebb987cec463feb8e76 [id=1042ec7801c740c09255102bf01b8fd2])
I20260808 20:00:14.020114 24021 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 20:00:14.021530 24021 catalog_manager.cc:1295] Loaded cluster ID: 9c4ad126d38943188e9e4422f5e27418
I20260808 20:00:14.021629 24021 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 20:00:14.023219 24021 catalog_manager.cc:1540] Loading token signing keys...
I20260808 20:00:14.024513 24021 catalog_manager.cc:6103] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Loaded TSK: 0
I20260808 20:00:14.025454 24021 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 20:00:14.026615 24021 catalog_manager.cc:1563] Loading latest processed Hive Metastore notification log event ID...
I20260808 20:00:14.027832 24021 catalog_manager.cc:5941] Last processed Hive Metastore notification event ID: 20
I20260808 20:00:14.040849 23667 master_service.cc:960] ReplaceTablet: received request to replace tablet 0ef3105d34f447a592fd4de0d08f347f from {username='slave'} at 127.0.0.1:45388
I20260808 20:00:14.042187 23668 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45388:
table { table_name: "default.Table_46d148afc6d142a0855d47f765b25297" } modify_external_catalogs: true
I20260808 20:00:14.040805 23671 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45388:
name: "default.Table_4390d242408442d790a0662898378018"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:14.040409 23674 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45388:
name: "default.Table_82b7aebd4f7e489a9d1a0195c22a240e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:14.041646 23670 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45388:
name: "default.Table_b7b099db34ef495387d5650e289948e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:14.044835 23668 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45388:
table { table_name: "default.Table_46d148afc6d142a0855d47f765b25297" } modify_external_catalogs: true
I20260808 20:00:14.042374 23676 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45388:
name: "default.Table_bfc21652528345b883ecf7962d128fee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:14.041126 23672 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45388:
name: "default.Table_8c377b83d1df43b59266a3da79324d5f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:14.040005 23675 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45388:
name: "default.Table_c327e82406e546f3be21f09b629548c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:14.039783 23678 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45388:
name: "default.Table_aa0809b208774982934a9f8de43aecf5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:14.042332 23677 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45388:
name: "default.Table_5730907850e643b4ac068a85e1574ddf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:14.050859 22302 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 4 FOLLOWER]: Refusing update from remote peer d2c4576401a74a60855647c956b195fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 87. Preceding OpId from leader: term: 4 index: 89. (index mismatch)
I20260808 20:00:14.052088 24020 consensus_queue.cc:1048] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 88, Last known committed idx: 87, Time since last communication: 0.000s
W20260808 20:00:14.052909 23638 consensus_peers.cc:597] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd -> Peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Couldn't send request to peer b91a1a84d6cd4038ac9d3ad2b8cf7979. Status: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
F20260808 20:00:14.054284 23769 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 27, previous 27; dumping first 8 out of 15 received events: NotificationEvent(eventId=21, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_831d17f2742e4fb8bc727d56fc9d1c85, message={"server":"","servicePrincipal":"","db":"default","table":"table_831d17f2742e4fb8bc727d56fc9d1c85","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_831d17f2742e4fb8bc727d56fc9d1c85\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219209},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_831d17f2742e4fb8bc727d56fc9d1c85\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_831d17f2742e4fb8bc727d56fc9d1c85\",\"kudu.table_id\":\"b47087e2cd6349b1ba2b8daf55b2d1d5\",\"transient_lastDdlTime\":\"1786219209\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=22, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_752d0310c94b42d3902fffa1070bb1d4, message={"server":"","servicePrincipal":"","db":"default","table":"table_752d0310c94b42d3902fffa1070bb1d4","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_752d0310c94b42d3902fffa1070bb1d4\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219209},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_752d0310c94b42d3902fffa1070bb1d4\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_752d0310c94b42d3902fffa1070bb1d4\",\"kudu.table_id\":\"3b10ed2d37fe46a5b63d646901474c8e\",\"transient_lastDdlTime\":\"1786219209\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1786219212, eventType=CREATE_TABLE, dbName=default, tableName=table_aa0809b208774982934a9f8de43aecf5, message={"server":"","servicePrincipal":"","db":"default","table":"table_aa0809b208774982934a9f8de43aecf5","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_aa0809b208774982934a9f8de43aecf5\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219212},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_aa0809b208774982934a9f8de43aecf5\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_aa0809b208774982934a9f8de43aecf5\",\"kudu.table_id\":\"1ba38449531f437d8795f5e35a3f9479\",\"transient_lastDdlTime\":\"1786219212\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=24, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_4dc166b247ee4cf89cdd926e07b51a51, message={"server":"","servicePrincipal":"","db":"default","table":"table_4dc166b247ee4cf89cdd926e07b51a51","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_4dc166b247ee4cf89cdd926e07b51a51\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219210},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_4dc166b247ee4cf89cdd926e07b51a51\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_4dc166b247ee4cf89cdd926e07b51a51\",\"kudu.table_id\":\"355ea74a32ec4502b6679611e8c8b67e\",\"transient_lastDdlTime\":\"1786219210\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=25, eventTime=1786219212, eventType=CREATE_TABLE, dbName=default, tableName=table_bfc21652528345b883ecf7962d128fee, message={"server":"","servicePrincipal":"","db":"default","table":"table_bfc21652528345b883ecf7962d128fee","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_bfc21652528345b883ecf7962d128fee\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219212},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_bfc21652528345b883ecf7962d128fee\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_bfc21652528345b883ecf7962d128fee\",\"kudu.table_id\":\"95d1dc4138bd491da51e09440dab7eee\",\"transient_lastDdlTime\":\"1786219212\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=26, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_324c660111c84a72a6935eb8e30a7ae6, message={"server":"","servicePrincipal":"","db":"default","table":"table_324c660111c84a72a6935eb8e30a7ae6","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_324c660111c84a72a6935eb8e30a7ae6\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219209},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_324c660111c84a72a6935eb8e30a7ae6\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_324c660111c84a72a6935eb8e30a7ae6\",\"kudu.table_id\":\"06447c1e53ac4366baae14ef41588d7f\",\"transient_lastDdlTime\":\"1786219209\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=27, eventTime=1786219212, eventType=CREATE_TABLE, dbName=default, tableName=table_42e6672ee7be4c4389fcc998d6eb322d, message={"server":"","servicePrincipal":"","db":"default","table":"table_42e6672ee7be4c4389fcc998d6eb322d","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_42e6672ee7be4c4389fcc998d6eb322d\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219212},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_42e6672ee7be4c4389fcc998d6eb322d\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_42e6672ee7be4c4389fcc998d6eb322d\",\"kudu.table_id\":\"67d34c9d2f51445e8cf367f41abbcc28\",\"transient_lastDdlTime\":\"1786219212\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=27, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_5730907850e643b4ac068a85e1574ddf, message={"server":"","servicePrincipal":"","db":"default","table":"table_5730907850e643b4ac068a85e1574ddf","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_5730907850e643b4ac068a85e1574ddf\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219212},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_5730907850e643b4ac068a85e1574ddf\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_5730907850e643b4ac068a85e1574ddf\",\"kudu.table_id\":\"bce1917a27c14330bfe2ccc5dc0b40a3\",\"transient_lastDdlTime\":\"1786219212\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
I20260808 20:00:14.055444 24010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2c4576401a74a60855647c956b195fd. Latest consensus state: current_term: 4 leader_uuid: "d2c4576401a74a60855647c956b195fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:14.055773 24010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7fa878d9cd5d google::LogMessage::Fail() at ??:0
I20260808 20:00:14.058576 23667 catalog_manager.cc:6006] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Sending DeleteTablet for 3 replicas of tablet 0ef3105d34f447a592fd4de0d08f347f
@ 0x7fa878da0b23 google::LogMessage::SendToLog() at ??:0
I20260808 20:00:14.058655 24010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "d2c4576401a74a60855647c956b195fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:14.058959 24010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:14.059383 24020 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "d2c4576401a74a60855647c956b195fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:14.059700 24020 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: This master's current role is: LEADER
@ 0x7fa878d9c75c google::LogMessage::Flush() at ??:0
I20260808 20:00:14.060711 23667 catalog_manager.cc:6807] ReplaceTablet: tablet 0ef3105d34f447a592fd4de0d08f347f deleted and replaced by tablet 1f1032c7852540c9bda3a1c37cd4bc9f
I20260808 20:00:14.061089 23667 master_service.cc:960] ReplaceTablet: received request to replace tablet ab9fb2ba3d5c490a992e704eb4582c82 from {username='slave'} at 127.0.0.1:45388
I20260808 20:00:14.063642 21649 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu pid 23482
I20260808 20:00:14.066641 23667 master_service.cc:960] ReplaceTablet: received request to replace tablet 96627957fadb4a0a8d9f69159d48cdf8 from {username='slave'} at 127.0.0.1:45388
@ 0x7fa878d9c9a1 google::LogMessage::~LogMessage() at ??:0
I20260808 20:00:14.096783 23136 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ef3105d34f447a592fd4de0d08f347f with delete_type TABLET_DATA_DELETED (replaced by tablet 1f1032c7852540c9bda3a1c37cd4bc9f) from {username='slave'} at 127.0.0.1:59508
@ 0x7fa88fa65f64 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260808 20:00:14.102324 23667 catalog_manager.cc:6006] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Sending DeleteTablet for 3 replicas of tablet 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:00:14.102862 23667 catalog_manager.cc:6807] ReplaceTablet: tablet 96627957fadb4a0a8d9f69159d48cdf8 deleted and replaced by tablet 5d0d61aef7854aa49fe36f2f505207b7
I20260808 20:00:14.103109 23667 master_service.cc:960] ReplaceTablet: received request to replace tablet 7117a3852b424a2d83a00b4ebab727cf from {username='slave'} at 127.0.0.1:45388
I20260808 20:00:14.103624 23143 tablet_service.cc:1511] Processing CreateTablet for tablet 1f1032c7852540c9bda3a1c37cd4bc9f (DEFAULT_TABLE table=default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:14.104233 23143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f1032c7852540c9bda3a1c37cd4bc9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:14.105103 22906 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ef3105d34f447a592fd4de0d08f347f with delete_type TABLET_DATA_DELETED (replaced by tablet 1f1032c7852540c9bda3a1c37cd4bc9f) from {username='slave'} at 127.0.0.1:37462
I20260808 20:00:14.108938 22901 tablet_service.cc:1511] Processing CreateTablet for tablet 1f1032c7852540c9bda3a1c37cd4bc9f (DEFAULT_TABLE table=default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:14.109467 22901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f1032c7852540c9bda3a1c37cd4bc9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:14.109967 22908 tablet_service.cc:1558] Processing DeleteTablet for tablet 96627957fadb4a0a8d9f69159d48cdf8 with delete_type TABLET_DATA_DELETED (replaced by tablet 5d0d61aef7854aa49fe36f2f505207b7) from {username='slave'} at 127.0.0.1:37462
I20260808 20:00:14.111186 23667 catalog_manager.cc:6006] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Sending DeleteTablet for 3 replicas of tablet 7117a3852b424a2d83a00b4ebab727cf
I20260808 20:00:14.111753 23667 catalog_manager.cc:6807] ReplaceTablet: tablet 7117a3852b424a2d83a00b4ebab727cf deleted and replaced by tablet 308609a3a4504bb5902009fd82d0775b
I20260808 20:00:14.112013 23667 master_service.cc:960] ReplaceTablet: received request to replace tablet d1c720d7dc8e4b8184ffc863a22cf9e3 from {username='slave'} at 127.0.0.1:45388
I20260808 20:00:14.114545 23135 tablet_service.cc:1558] Processing DeleteTablet for tablet 96627957fadb4a0a8d9f69159d48cdf8 with delete_type TABLET_DATA_DELETED (replaced by tablet 5d0d61aef7854aa49fe36f2f505207b7) from {username='slave'} at 127.0.0.1:59508
I20260808 20:00:14.114856 23144 tablet_service.cc:1558] Processing DeleteTablet for tablet 7117a3852b424a2d83a00b4ebab727cf with delete_type TABLET_DATA_DELETED (replaced by tablet 308609a3a4504bb5902009fd82d0775b) from {username='slave'} at 127.0.0.1:59508
I20260808 20:00:14.115255 22908 tablet_service.cc:1558] Processing DeleteTablet for tablet 7117a3852b424a2d83a00b4ebab727cf with delete_type TABLET_DATA_DELETED (replaced by tablet 308609a3a4504bb5902009fd82d0775b) from {username='slave'} at 127.0.0.1:37462
I20260808 20:00:14.117574 23726 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 20:00:14.120572 24058 tablet_replica.cc:333] T 0ef3105d34f447a592fd4de0d08f347f P e34d5caee97d44fa945a91ddc6a54653: stopping tablet replica
I20260808 20:00:14.120841 24058 raft_consensus.cc:2243] T 0ef3105d34f447a592fd4de0d08f347f P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:14.121131 24058 raft_consensus.cc:2272] T 0ef3105d34f447a592fd4de0d08f347f P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:14.121953 24058 ts_tablet_manager.cc:1916] T 0ef3105d34f447a592fd4de0d08f347f P e34d5caee97d44fa945a91ddc6a54653: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:14.129616 24058 ts_tablet_manager.cc:1929] T 0ef3105d34f447a592fd4de0d08f347f P e34d5caee97d44fa945a91ddc6a54653: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 20:00:14.129791 24058 log.cc:1199] T 0ef3105d34f447a592fd4de0d08f347f P e34d5caee97d44fa945a91ddc6a54653: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/wal/wals/0ef3105d34f447a592fd4de0d08f347f
I20260808 20:00:14.130287 24058 ts_tablet_manager.cc:1950] T 0ef3105d34f447a592fd4de0d08f347f P e34d5caee97d44fa945a91ddc6a54653: Deleting consensus metadata
@ 0x7fa88fa64811 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260808 20:00:14.131875 24058 tablet_replica.cc:333] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653: stopping tablet replica
I20260808 20:00:14.132115 24058 raft_consensus.cc:2243] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653 [term 1 LEADER]: Raft consensus shutting down.
I20260808 20:00:14.132513 24058 raft_consensus.cc:2272] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:14.132964 24055 tablet_replica.cc:333] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9: stopping tablet replica
I20260808 20:00:14.133158 24058 ts_tablet_manager.cc:1916] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:14.133198 24055 raft_consensus.cc:2243] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 LEADER]: Raft consensus shutting down.
I20260808 20:00:14.133423 24066 tablet_bootstrap.cc:492] T 1f1032c7852540c9bda3a1c37cd4bc9f P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:14.133687 24055 raft_consensus.cc:2272] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:14.134307 24055 ts_tablet_manager.cc:1916] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:14.136293 24065 tablet_bootstrap.cc:492] T 1f1032c7852540c9bda3a1c37cd4bc9f P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:14.138338 24065 tablet_bootstrap.cc:654] T 1f1032c7852540c9bda3a1c37cd4bc9f P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:14.139534 24066 tablet_bootstrap.cc:654] T 1f1032c7852540c9bda3a1c37cd4bc9f P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:14.140767 24058 ts_tablet_manager.cc:1929] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260808 20:00:14.140915 24058 log.cc:1199] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/wal/wals/96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:00:14.143919 24066 tablet_bootstrap.cc:492] T 1f1032c7852540c9bda3a1c37cd4bc9f P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:14.144074 24066 ts_tablet_manager.cc:1403] T 1f1032c7852540c9bda3a1c37cd4bc9f P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.003s
I20260808 20:00:14.144914 24066 raft_consensus.cc:359] T 1f1032c7852540c9bda3a1c37cd4bc9f P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:14.145104 24066 raft_consensus.cc:385] T 1f1032c7852540c9bda3a1c37cd4bc9f P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:14.145182 24066 raft_consensus.cc:740] T 1f1032c7852540c9bda3a1c37cd4bc9f P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:14.145488 24066 consensus_queue.cc:260] T 1f1032c7852540c9bda3a1c37cd4bc9f P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
@ 0x7fa88fa6c48c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260808 20:00:14.149348 24066 ts_tablet_manager.cc:1434] T 1f1032c7852540c9bda3a1c37cd4bc9f P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260808 20:00:14.154603 24065 tablet_bootstrap.cc:492] T 1f1032c7852540c9bda3a1c37cd4bc9f P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:14.154810 24065 ts_tablet_manager.cc:1403] T 1f1032c7852540c9bda3a1c37cd4bc9f P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.003s
I20260808 20:00:14.155889 24065 raft_consensus.cc:359] T 1f1032c7852540c9bda3a1c37cd4bc9f P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:14.157137 24065 raft_consensus.cc:385] T 1f1032c7852540c9bda3a1c37cd4bc9f P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:14.157469 24065 raft_consensus.cc:740] T 1f1032c7852540c9bda3a1c37cd4bc9f P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:14.157760 24065 consensus_queue.cc:260] T 1f1032c7852540c9bda3a1c37cd4bc9f P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:14.158231 24058 ts_tablet_manager.cc:1950] T 96627957fadb4a0a8d9f69159d48cdf8 P e34d5caee97d44fa945a91ddc6a54653: Deleting consensus metadata
I20260808 20:00:14.159380 24058 tablet_replica.cc:333] T 7117a3852b424a2d83a00b4ebab727cf P e34d5caee97d44fa945a91ddc6a54653: stopping tablet replica
I20260808 20:00:14.160111 24058 raft_consensus.cc:2243] T 7117a3852b424a2d83a00b4ebab727cf P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:14.160334 24058 raft_consensus.cc:2272] T 7117a3852b424a2d83a00b4ebab727cf P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:14.160806 24058 ts_tablet_manager.cc:1916] T 7117a3852b424a2d83a00b4ebab727cf P e34d5caee97d44fa945a91ddc6a54653: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:14.165994 24058 ts_tablet_manager.cc:1929] T 7117a3852b424a2d83a00b4ebab727cf P e34d5caee97d44fa945a91ddc6a54653: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 20:00:14.166102 24058 log.cc:1199] T 7117a3852b424a2d83a00b4ebab727cf P e34d5caee97d44fa945a91ddc6a54653: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/wal/wals/7117a3852b424a2d83a00b4ebab727cf
I20260808 20:00:14.166405 24058 ts_tablet_manager.cc:1950] T 7117a3852b424a2d83a00b4ebab727cf P e34d5caee97d44fa945a91ddc6a54653: Deleting consensus metadata
I20260808 20:00:14.169315 24055 ts_tablet_manager.cc:1929] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 20:00:14.169494 24055 log.cc:1199] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/wal/wals/0ef3105d34f447a592fd4de0d08f347f
I20260808 20:00:14.170017 24065 ts_tablet_manager.cc:1434] T 1f1032c7852540c9bda3a1c37cd4bc9f P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.013s user 0.000s sys 0.003s
I20260808 20:00:14.170285 24055 ts_tablet_manager.cc:1950] T 0ef3105d34f447a592fd4de0d08f347f P 5f6b6c2e318d44a984120a06a09e9af9: Deleting consensus metadata
I20260808 20:00:14.171929 24055 tablet_replica.cc:333] T 96627957fadb4a0a8d9f69159d48cdf8 P 5f6b6c2e318d44a984120a06a09e9af9: stopping tablet replica
I20260808 20:00:14.172152 24055 raft_consensus.cc:2243] T 96627957fadb4a0a8d9f69159d48cdf8 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:14.172341 24055 raft_consensus.cc:2272] T 96627957fadb4a0a8d9f69159d48cdf8 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:14.172959 24055 ts_tablet_manager.cc:1916] T 96627957fadb4a0a8d9f69159d48cdf8 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:14.180205 24055 ts_tablet_manager.cc:1929] T 96627957fadb4a0a8d9f69159d48cdf8 P 5f6b6c2e318d44a984120a06a09e9af9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260808 20:00:14.180370 24055 log.cc:1199] T 96627957fadb4a0a8d9f69159d48cdf8 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/wal/wals/96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:00:14.180809 24055 ts_tablet_manager.cc:1950] T 96627957fadb4a0a8d9f69159d48cdf8 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting consensus metadata
I20260808 20:00:14.182111 24055 tablet_replica.cc:333] T 7117a3852b424a2d83a00b4ebab727cf P 5f6b6c2e318d44a984120a06a09e9af9: stopping tablet replica
I20260808 20:00:14.182312 24055 raft_consensus.cc:2243] T 7117a3852b424a2d83a00b4ebab727cf P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:14.182510 24055 raft_consensus.cc:2272] T 7117a3852b424a2d83a00b4ebab727cf P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:14.183080 24055 ts_tablet_manager.cc:1916] T 7117a3852b424a2d83a00b4ebab727cf P 5f6b6c2e318d44a984120a06a09e9af9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:14.190618 24055 ts_tablet_manager.cc:1929] T 7117a3852b424a2d83a00b4ebab727cf P 5f6b6c2e318d44a984120a06a09e9af9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 20:00:14.190806 24055 log.cc:1199] T 7117a3852b424a2d83a00b4ebab727cf P 5f6b6c2e318d44a984120a06a09e9af9: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/wal/wals/7117a3852b424a2d83a00b4ebab727cf
I20260808 20:00:14.191256 24055 ts_tablet_manager.cc:1950] T 7117a3852b424a2d83a00b4ebab727cf P 5f6b6c2e318d44a984120a06a09e9af9: Deleting consensus metadata
I20260808 20:00:14.292786 23615 catalog_manager.cc:5050] TS e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): tablet 0ef3105d34f447a592fd4de0d08f347f (table default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619]) successfully deleted
W20260808 20:00:14.293188 23615 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.21.36.66:46229, user_credentials={real_user=slave}} blocked reactor thread for 161022us
I20260808 20:00:14.293967 23615 catalog_manager.cc:5050] TS e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): tablet 96627957fadb4a0a8d9f69159d48cdf8 (table default.table_4dc166b247ee4cf89cdd926e07b51a51 [id=355ea74a32ec4502b6679611e8c8b67e]) successfully deleted
I20260808 20:00:14.294171 23615 catalog_manager.cc:5050] TS e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): tablet 7117a3852b424a2d83a00b4ebab727cf (table default.table_1cd24efa52a547cc872dd7ffe4938fb8 [id=87fca666b411494c8486baf1bfa58327]) successfully deleted
I20260808 20:00:14.294727 23640 catalog_manager.cc:5050] TS 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): tablet 0ef3105d34f447a592fd4de0d08f347f (table default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619]) successfully deleted
I20260808 20:00:14.294941 23640 catalog_manager.cc:5050] TS 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): tablet 96627957fadb4a0a8d9f69159d48cdf8 (table default.table_4dc166b247ee4cf89cdd926e07b51a51 [id=355ea74a32ec4502b6679611e8c8b67e]) successfully deleted
I20260808 20:00:14.295138 23640 catalog_manager.cc:5050] TS 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): tablet 7117a3852b424a2d83a00b4ebab727cf (table default.table_1cd24efa52a547cc872dd7ffe4938fb8 [id=87fca666b411494c8486baf1bfa58327]) successfully deleted
@ 0x7fa88fa6c309 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaaf86d std::function<>::operator()() at ??:?
I20260808 20:00:14.297250 21649 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu with pid 23482
I20260808 20:00:14.323429 23969 raft_consensus.cc:493] T 3c66d42b171948bba3f76c598b60e858 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:14.323684 23969 raft_consensus.cc:515] T 3c66d42b171948bba3f76c598b60e858 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:14.324761 23969 leader_election.cc:290] T 3c66d42b171948bba3f76c598b60e858 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:14.325047 22941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c66d42b171948bba3f76c598b60e858" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653" is_pre_election: true
I20260808 20:00:14.325564 23177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c66d42b171948bba3f76c598b60e858" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9" is_pre_election: true
I20260808 20:00:14.325845 23177 raft_consensus.cc:2393] T 3c66d42b171948bba3f76c598b60e858 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 257c9c7e0c6c441593eac06beb31fa4e in current term 1: Already voted for candidate e34d5caee97d44fa945a91ddc6a54653 in this term.
I20260808 20:00:14.326393 22607 leader_election.cc:304] T 3c66d42b171948bba3f76c598b60e858 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:00:14.326908 23969 raft_consensus.cc:3060] T 3c66d42b171948bba3f76c598b60e858 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:14.330201 23969 raft_consensus.cc:2749] T 3c66d42b171948bba3f76c598b60e858 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260808 20:00:14.334193 23276 connection.cc:573] client connection to 127.21.36.126:43945 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 20:00:14.334447 24032 negotiation.cc:336] Failed RPC negotiation. Trace:
0808 20:00:14.061807 (+ 0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:54426 (local address 127.21.36.65:39923)
0808 20:00:14.101284 (+ 39477us) server_negotiation.cc:207] Beginning negotiation
0808 20:00:14.101290 (+ 6us) server_negotiation.cc:400] Waiting for connection header
0808 20:00:14.101310 (+ 20us) server_negotiation.cc:408] Connection header received
0808 20:00:14.101382 (+ 72us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0808 20:00:14.101388 (+ 6us) server_negotiation.cc:462] Received NEGOTIATE request from client
0808 20:00:14.101482 (+ 94us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0808 20:00:14.117850 (+ 16368us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
0808 20:00:14.294454 (+176604us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
0808 20:00:14.295932 (+ 1478us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
0808 20:00:14.334190 (+ 38258us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54426: BlockingRecv error: recv got EOF from 127.0.0.1:54426 (error 108)
Metrics: {"server-negotiator.queue_time_us":39346,"thread_start_us":51119,"threads_started":1}
W20260808 20:00:14.335983 23276 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.21.36.126:43945)
I20260808 20:00:14.398885 23948 consensus_queue.cc:1048] T 3c66d42b171948bba3f76c598b60e858 P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:14.406749 24083 consensus_queue.cc:1048] T 3c66d42b171948bba3f76c598b60e858 P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:14.495901 24078 consensus_queue.cc:1048] T 2086c55bb74a4997bcc9a49205ecf0f5 P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:14.501945 24077 consensus_queue.cc:1048] T 2086c55bb74a4997bcc9a49205ecf0f5 P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:14.543901 24085 consensus_queue.cc:1048] T 746ad131d3534fedb10eef21b4bd23ee P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:14.551209 24083 consensus_queue.cc:1048] T 746ad131d3534fedb10eef21b4bd23ee P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:14.616173 24101 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d2c4576401a74a60855647c956b195fd)
I20260808 20:00:14.616369 24101 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:14.617218 24101 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:00:14.617368 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 1: this message will repeat every 5th retry.
W20260808 20:00:14.619688 22268 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:00:14.619876 22267 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:00:14.619999 22267 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:00:14.620312 24101 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260808 20:00:14.631543 24083 raft_consensus.cc:493] T 1f1032c7852540c9bda3a1c37cd4bc9f P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:14.631739 24083 raft_consensus.cc:515] T 1f1032c7852540c9bda3a1c37cd4bc9f P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:14.632519 24083 leader_election.cc:290] T 1f1032c7852540c9bda3a1c37cd4bc9f P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:14.633176 23177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1032c7852540c9bda3a1c37cd4bc9f" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9" is_pre_election: true
I20260808 20:00:14.633459 23177 raft_consensus.cc:2468] T 1f1032c7852540c9bda3a1c37cd4bc9f P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 0.
W20260808 20:00:14.633714 22831 leader_election.cc:343] T 1f1032c7852540c9bda3a1c37cd4bc9f P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Not found: Tablet not found: 1f1032c7852540c9bda3a1c37cd4bc9f
I20260808 20:00:14.634052 22835 leader_election.cc:304] T 1f1032c7852540c9bda3a1c37cd4bc9f P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653; no voters: 257c9c7e0c6c441593eac06beb31fa4e
I20260808 20:00:14.634373 24083 raft_consensus.cc:2804] T 1f1032c7852540c9bda3a1c37cd4bc9f P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:14.634500 24083 raft_consensus.cc:493] T 1f1032c7852540c9bda3a1c37cd4bc9f P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:14.634603 24083 raft_consensus.cc:3060] T 1f1032c7852540c9bda3a1c37cd4bc9f P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:14.637372 24083 raft_consensus.cc:515] T 1f1032c7852540c9bda3a1c37cd4bc9f P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:14.638037 24083 leader_election.cc:290] T 1f1032c7852540c9bda3a1c37cd4bc9f P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 election: Requested vote from peers 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:14.638945 23177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1032c7852540c9bda3a1c37cd4bc9f" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9"
I20260808 20:00:14.639195 23177 raft_consensus.cc:3060] T 1f1032c7852540c9bda3a1c37cd4bc9f P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:14.641310 23177 raft_consensus.cc:2468] T 1f1032c7852540c9bda3a1c37cd4bc9f P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 1.
W20260808 20:00:14.639017 22831 leader_election.cc:343] T 1f1032c7852540c9bda3a1c37cd4bc9f P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Not found: Tablet not found: 1f1032c7852540c9bda3a1c37cd4bc9f
I20260808 20:00:14.642127 22835 leader_election.cc:304] T 1f1032c7852540c9bda3a1c37cd4bc9f P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653; no voters: 257c9c7e0c6c441593eac06beb31fa4e
I20260808 20:00:14.642505 24083 raft_consensus.cc:2804] T 1f1032c7852540c9bda3a1c37cd4bc9f P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:14.642681 24083 raft_consensus.cc:697] T 1f1032c7852540c9bda3a1c37cd4bc9f P e34d5caee97d44fa945a91ddc6a54653 [term 1 LEADER]: Becoming Leader. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Running, Role: LEADER
I20260808 20:00:14.643414 24083 consensus_queue.cc:237] T 1f1032c7852540c9bda3a1c37cd4bc9f P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:14.722267 23846 consensus_queue.cc:1048] T 57c91cdb20e74754b418cbc9af674632 P 5f6b6c2e318d44a984120a06a09e9af9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:14.723515 24083 consensus_queue.cc:1048] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:14.731397 24109 consensus_queue.cc:1048] T 57c91cdb20e74754b418cbc9af674632 P 5f6b6c2e318d44a984120a06a09e9af9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:14.738082 24083 consensus_queue.cc:1048] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:14.797993 24083 consensus_queue.cc:1048] T 9b63e4c056f34242aacef5ffafb14b25 P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:14.807705 24085 consensus_queue.cc:1048] T 9b63e4c056f34242aacef5ffafb14b25 P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 20:00:15.173365 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 1: this message will repeat every 5th retry.
I20260808 20:00:15.247841 21649 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu
/tmp/dist-test-taskNcG5N9/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.36.126:43945
--webserver_interface=127.21.36.126
--webserver_port=37243
--builtin_ntp_servers=127.21.36.84:34883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593
--hive_metastore_uris=thrift://127.0.0.1:44789
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260808 20:00:15.338945 24135 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d2c4576401a74a60855647c956b195fd)
I20260808 20:00:15.339166 24135 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:15.340021 24135 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:00:15.342490 22268 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:00:15.342707 22267 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:00:15.342839 22267 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:00:15.343112 24135 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260808 20:00:15.417995 24085 consensus_queue.cc:1048] T 1f1032c7852540c9bda3a1c37cd4bc9f P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 20:00:15.426502 22831 consensus_peers.cc:597] T 1f1032c7852540c9bda3a1c37cd4bc9f P e34d5caee97d44fa945a91ddc6a54653 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f1032c7852540c9bda3a1c37cd4bc9f. This is attempt 1: this message will repeat every 5th retry.
W20260808 20:00:15.632995 24124 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 20:00:15.633394 24124 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 20:00:15.633522 24124 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260808 20:00:15.642472 24124 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 20:00:15.642637 24124 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260808 20:00:15.642736 24124 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 20:00:15.642800 24124 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260808 20:00:15.654467 24124 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.36.84:34883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:44789
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.36.126:43945
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.36.126
--webserver_port=37243
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 08 Aug 2026 19:43:23 UTC on bdcb31816ec0
build id 13246
ASAN enabled
I20260808 20:00:15.656543 24124 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 20:00:15.659025 24124 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 20:00:15.668829 24164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 20:00:15.669112 24165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 20:00:15.670476 24169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 20:00:15.670672 24124 server_base.cc:1061] running on GCE node
I20260808 20:00:15.671649 24124 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 20:00:15.673323 24124 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 20:00:15.674602 24124 hybrid_clock.cc:648] HybridClock initialized: now 1786219215674523 us; error 60 us; skew 500 ppm
I20260808 20:00:15.675032 24124 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 20:00:15.677554 24124 webserver.cc:533] Webserver started at http://127.21.36.126:37243/ using document root <none> and password file <none>
I20260808 20:00:15.678450 24124 fs_manager.cc:362] Metadata directory not provided
I20260808 20:00:15.678579 24124 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 20:00:15.684508 24124 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 20:00:15.687696 24177 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 20:00:15.689211 24124 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 20:00:15.689385 24124 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data,/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/wal
uuid: "d2c4576401a74a60855647c956b195fd"
format_stamp: "Formatted at 2026-08-08 20:00:04 on dist-test-slave-pww0"
I20260808 20:00:15.690140 24124 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 20:00:15.718209 24124 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 20:00:15.719216 24124 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 20:00:15.719574 24124 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 20:00:15.743700 24124 rpc_server.cc:307] RPC server started. Bound to: 127.21.36.126:43945
I20260808 20:00:15.743703 24265 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.36.126:43945 every 8 connection(s)
I20260808 20:00:15.745577 24124 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data/info.pb
I20260808 20:00:15.754725 21649 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu as pid 24124
I20260808 20:00:15.756826 24266 sys_catalog.cc:263] Verifying existing consensus state
I20260808 20:00:15.762851 24266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Bootstrap starting.
I20260808 20:00:15.777725 23017 heartbeater.cc:344] Connected to a master server at 127.21.36.126:43945
I20260808 20:00:15.789251 24266 log.cc:826] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Log is configured to *not* fsync() on all Append() calls
I20260808 20:00:15.857118 24266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Bootstrap replayed 1/1 log segments. Stats: ops{read=93 overwritten=0 applied=92 ignored=0} inserts{seen=61 ignored=0} mutations{seen=68 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260808 20:00:15.857775 24266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Bootstrap complete.
I20260808 20:00:15.863513 24266 raft_consensus.cc:359] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 4 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:15.866514 24266 raft_consensus.cc:740] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2c4576401a74a60855647c956b195fd, State: Initialized, Role: FOLLOWER
I20260808 20:00:15.867308 24266 consensus_queue.cc:260] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 92, Last appended: 4.93, Last appended by leader: 93, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:15.868151 24278 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:15.868446 24278 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:15.869319 24266 sys_catalog.cc:565] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 20:00:15.884667 24305 catalog_manager.cc:1295] Loaded cluster ID: 9c4ad126d38943188e9e4422f5e27418
I20260808 20:00:15.884789 24305 catalog_manager.cc:1588] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: loading cluster ID for follower catalog manager: success
I20260808 20:00:15.889583 24305 catalog_manager.cc:1610] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: acquiring CA information for follower catalog manager: success
I20260808 20:00:15.898703 24305 catalog_manager.cc:1638] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 20:00:15.911779 24124 master_runner.cc:187] Error getting master registration for 127.21.36.124:34593: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111),
I20260808 20:00:15.915616 24124 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:00:15.931205 23256 heartbeater.cc:344] Connected to a master server at 127.21.36.126:43945
I20260808 20:00:15.934947 24209 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" instance_seqno: 1786219208132788) as {username='slave'} at 127.21.36.67:37329; Asking this server to re-register.
I20260808 20:00:15.935963 23256 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:15.938482 24209 ts_manager.cc:194] Registered new tserver with Master: 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:16.062767 22794 heartbeater.cc:344] Connected to a master server at 127.21.36.126:43945
I20260808 20:00:16.065238 24209 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" instance_seqno: 1786219207065397) as {username='slave'} at 127.21.36.65:38007; Asking this server to re-register.
I20260808 20:00:16.066134 22794 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:16.068166 24209 ts_manager.cc:194] Registered new tserver with Master: 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923)
I20260808 20:00:16.091405 22236 master_runner.cc:187] Error getting master registration for 127.21.36.124:34593: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111),
I20260808 20:00:16.091653 22236 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:00:16.271636 24322 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d2c4576401a74a60855647c956b195fd)
I20260808 20:00:16.271839 24322 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:16.272771 24322 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:00:16.273412 22267 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111) [suppressed 6 similar messages]
I20260808 20:00:16.273558 24221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "16a59d796024414abf9f82a7593530a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 93 } } ignore_live_leader: false dest_uuid: "d2c4576401a74a60855647c956b195fd" is_pre_election: true
I20260808 20:00:16.274199 24221 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16a59d796024414abf9f82a7593530a6 in term 4.
I20260808 20:00:16.274864 22268 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16a59d796024414abf9f82a7593530a6, d2c4576401a74a60855647c956b195fd; no voters:
I20260808 20:00:16.275133 24322 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260808 20:00:16.275125 22267 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:00:16.275295 24322 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d2c4576401a74a60855647c956b195fd)
I20260808 20:00:16.275395 24322 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 4 FOLLOWER]: Advancing to term 5
I20260808 20:00:16.277562 24322 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:16.278167 24322 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 5 election: Requested vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
I20260808 20:00:16.278713 24221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "16a59d796024414abf9f82a7593530a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 93 } } ignore_live_leader: false dest_uuid: "d2c4576401a74a60855647c956b195fd"
I20260808 20:00:16.278926 24221 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 4 FOLLOWER]: Advancing to term 5
W20260808 20:00:16.279804 22267 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:00:16.282882 24221 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16a59d796024414abf9f82a7593530a6 in term 5.
I20260808 20:00:16.283425 22268 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16a59d796024414abf9f82a7593530a6, d2c4576401a74a60855647c956b195fd; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979
I20260808 20:00:16.283766 24322 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 5 FOLLOWER]: Leader election won for term 5
I20260808 20:00:16.284312 24322 raft_consensus.cc:697] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 5 LEADER]: Becoming Leader. State: Replica: 16a59d796024414abf9f82a7593530a6, State: Running, Role: LEADER
I20260808 20:00:16.284708 24322 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 93, Committed index: 93, Last appended: 4.93, Last appended by leader: 93, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:16.285327 24209 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" instance_seqno: 1786219207598982) as {username='slave'} at 127.21.36.66:41859; Asking this server to re-register.
I20260808 20:00:16.286259 23017 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:16.287966 24330 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16a59d796024414abf9f82a7593530a6. Latest consensus state: current_term: 5 leader_uuid: "16a59d796024414abf9f82a7593530a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:16.288290 24330 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: This master's current role is: LEADER
I20260808 20:00:16.288312 24209 ts_manager.cc:194] Registered new tserver with Master: e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:16.289018 24335 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 20:00:16.292234 24335 catalog_manager.cc:679] Loaded metadata for table default.table_f7a6e8903ed74dc088eb1f490788c54b [id=0145ea517a7a4aec99304181d1c6cb28]
I20260808 20:00:16.292784 24335 catalog_manager.cc:679] Loaded metadata for table default.table_324c660111c84a72a6935eb8e30a7ae6 [id=06447c1e53ac4366baae14ef41588d7f]
I20260808 20:00:16.293217 24335 catalog_manager.cc:679] Loaded metadata for table default.table_61bf42c8286347d197162895f70520d7 [id=08230c16ec604c259195bbfa0c062164]
I20260808 20:00:16.293617 24335 catalog_manager.cc:679] Loaded metadata for table default.table_3ffa098d41af4ebb987cec463feb8e76 [id=1042ec7801c740c09255102bf01b8fd2]
I20260808 20:00:16.293988 24335 catalog_manager.cc:679] Loaded metadata for table default.table_4dc166b247ee4cf89cdd926e07b51a51 [id=355ea74a32ec4502b6679611e8c8b67e]
I20260808 20:00:16.294618 24335 catalog_manager.cc:679] Loaded metadata for table default.table_752d0310c94b42d3902fffa1070bb1d4 [id=3b10ed2d37fe46a5b63d646901474c8e]
I20260808 20:00:16.295017 24335 catalog_manager.cc:679] Loaded metadata for table default.table_4ed5029dcfbd499db24fb72e6b389d42 [id=43498092c52a457d93f97ba0993e6012]
I20260808 20:00:16.295378 24335 catalog_manager.cc:679] Loaded metadata for table default.table_732a1b16caff489aa844bba46e6ec1cb [id=524bfe483c7f4c4d99d2757ff290c5eb]
I20260808 20:00:16.295903 24335 catalog_manager.cc:679] Loaded metadata for table default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528]
I20260808 20:00:16.296381 24335 catalog_manager.cc:679] Loaded metadata for table default.table_42e6672ee7be4c4389fcc998d6eb322d [id=67d34c9d2f51445e8cf367f41abbcc28]
I20260808 20:00:16.296773 24335 catalog_manager.cc:679] Loaded metadata for table default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619]
I20260808 20:00:16.297155 24335 catalog_manager.cc:679] Loaded metadata for table default.table_1cd24efa52a547cc872dd7ffe4938fb8 [id=87fca666b411494c8486baf1bfa58327]
I20260808 20:00:16.297550 24335 catalog_manager.cc:679] Loaded metadata for table default.table_5a92fa3792a1443f94a707060264359c [id=89520ebff12347f18df06b25577ecf63]
I20260808 20:00:16.297976 24335 catalog_manager.cc:679] Loaded metadata for table default.table_530ab728450b4272b3e9573534afe4e6 [id=8c917809771f4262811b9f200ff0e925]
I20260808 20:00:16.298360 24335 catalog_manager.cc:679] Loaded metadata for table default.table_583f1fdac11148488799008b032f7ef2 [id=99b11a3c5ca3411b8c1800c70f61597a]
I20260808 20:00:16.298741 24335 catalog_manager.cc:679] Loaded metadata for table default.table_831d17f2742e4fb8bc727d56fc9d1c85 [id=b47087e2cd6349b1ba2b8daf55b2d1d5]
I20260808 20:00:16.299150 24335 catalog_manager.cc:679] Loaded metadata for table default.table_ba9e157aaf3a487eb4f3f2ec9c37b761 [id=edaf172891fe4dafbc1b00bbb27d9c1c]
I20260808 20:00:16.299607 24335 catalog_manager.cc:679] Loaded metadata for table default.table_01314a1f924d4e33bdecf8797a6e2e0a [id=fb4aaf09a463481d9f5512884b9574d7]
I20260808 20:00:16.302008 24335 tablet_loader.cc:96] loaded metadata for tablet 1f1032c7852540c9bda3a1c37cd4bc9f (table default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619])
I20260808 20:00:16.302531 24335 tablet_loader.cc:96] loaded metadata for tablet 2086c55bb74a4997bcc9a49205ecf0f5 (table default.table_01314a1f924d4e33bdecf8797a6e2e0a [id=fb4aaf09a463481d9f5512884b9574d7])
I20260808 20:00:16.302929 24335 tablet_loader.cc:96] loaded metadata for tablet 2523719318f84e31862e40d76f9a23f5 (table default.table_5a92fa3792a1443f94a707060264359c [id=89520ebff12347f18df06b25577ecf63])
I20260808 20:00:16.303345 24335 tablet_loader.cc:96] loaded metadata for tablet 286e98ffe9b44ada92fd8e9776578df2 (table default.table_732a1b16caff489aa844bba46e6ec1cb [id=524bfe483c7f4c4d99d2757ff290c5eb])
I20260808 20:00:16.304016 24335 tablet_loader.cc:96] loaded metadata for tablet 308609a3a4504bb5902009fd82d0775b (table default.table_1cd24efa52a547cc872dd7ffe4938fb8 [id=87fca666b411494c8486baf1bfa58327])
I20260808 20:00:16.304373 24335 tablet_loader.cc:96] loaded metadata for tablet 3c66d42b171948bba3f76c598b60e858 (table default.table_f7a6e8903ed74dc088eb1f490788c54b [id=0145ea517a7a4aec99304181d1c6cb28])
I20260808 20:00:16.305017 24335 tablet_loader.cc:96] loaded metadata for tablet 553ff75afb1d47d9b48410b8d6fa13dc (table default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528])
I20260808 20:00:16.305430 24335 tablet_loader.cc:96] loaded metadata for tablet 55cf64ca16df4afbae5f58843f613f27 (table default.table_530ab728450b4272b3e9573534afe4e6 [id=8c917809771f4262811b9f200ff0e925])
I20260808 20:00:16.305795 24335 tablet_loader.cc:96] loaded metadata for tablet 57c91cdb20e74754b418cbc9af674632 (table default.table_42e6672ee7be4c4389fcc998d6eb322d [id=67d34c9d2f51445e8cf367f41abbcc28])
I20260808 20:00:16.306161 24335 tablet_loader.cc:96] loaded metadata for tablet 5d0d61aef7854aa49fe36f2f505207b7 (table default.table_4dc166b247ee4cf89cdd926e07b51a51 [id=355ea74a32ec4502b6679611e8c8b67e])
I20260808 20:00:16.306984 24335 tablet_loader.cc:96] loaded metadata for tablet 746ad131d3534fedb10eef21b4bd23ee (table default.table_61bf42c8286347d197162895f70520d7 [id=08230c16ec604c259195bbfa0c062164])
I20260808 20:00:16.307397 24335 tablet_loader.cc:96] loaded metadata for tablet 78ab65d40a004ef9888b6577716b783c (table default.table_583f1fdac11148488799008b032f7ef2 [id=99b11a3c5ca3411b8c1800c70f61597a])
I20260808 20:00:16.308297 24335 tablet_loader.cc:96] loaded metadata for tablet 9b63e4c056f34242aacef5ffafb14b25 (table default.table_ba9e157aaf3a487eb4f3f2ec9c37b761 [id=edaf172891fe4dafbc1b00bbb27d9c1c])
I20260808 20:00:16.309206 24335 tablet_loader.cc:96] loaded metadata for tablet b45729e2ec9e4a77b8be89f9657b0424 (table default.table_4ed5029dcfbd499db24fb72e6b389d42 [id=43498092c52a457d93f97ba0993e6012])
I20260808 20:00:16.309553 24335 tablet_loader.cc:96] loaded metadata for tablet b8948ef8ed844727b9fed1e91d9233f6 (table default.table_324c660111c84a72a6935eb8e30a7ae6 [id=06447c1e53ac4366baae14ef41588d7f])
I20260808 20:00:16.309962 24335 tablet_loader.cc:96] loaded metadata for tablet c75913753d95447783b9b7c7bb6ee701 (table default.table_752d0310c94b42d3902fffa1070bb1d4 [id=3b10ed2d37fe46a5b63d646901474c8e])
I20260808 20:00:16.310326 24335 tablet_loader.cc:96] loaded metadata for tablet d1c720d7dc8e4b8184ffc863a22cf9e3 (table default.table_831d17f2742e4fb8bc727d56fc9d1c85 [id=b47087e2cd6349b1ba2b8daf55b2d1d5])
I20260808 20:00:16.311102 24335 tablet_loader.cc:96] loaded metadata for tablet e18581438df6444e98c94b958a31650c (table default.table_3ffa098d41af4ebb987cec463feb8e76 [id=1042ec7801c740c09255102bf01b8fd2])
I20260808 20:00:16.311947 24335 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 20:00:16.313608 24335 catalog_manager.cc:1295] Loaded cluster ID: 9c4ad126d38943188e9e4422f5e27418
I20260808 20:00:16.313704 24335 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 20:00:16.315670 24335 catalog_manager.cc:1540] Loading token signing keys...
I20260808 20:00:16.317076 24335 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6: Loaded TSK: 0
I20260808 20:00:16.317675 24335 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 20:00:16.318733 24335 catalog_manager.cc:1563] Loading latest processed Hive Metastore notification log event ID...
I20260808 20:00:16.319818 24335 catalog_manager.cc:5941] Last processed Hive Metastore notification event ID: 20
F20260808 20:00:16.374569 22545 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 27, previous 27; dumping first 8 out of 15 received events: NotificationEvent(eventId=21, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_831d17f2742e4fb8bc727d56fc9d1c85, message={"server":"","servicePrincipal":"","db":"default","table":"table_831d17f2742e4fb8bc727d56fc9d1c85","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_831d17f2742e4fb8bc727d56fc9d1c85\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219209},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_831d17f2742e4fb8bc727d56fc9d1c85\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_831d17f2742e4fb8bc727d56fc9d1c85\",\"kudu.table_id\":\"b47087e2cd6349b1ba2b8daf55b2d1d5\",\"transient_lastDdlTime\":\"1786219209\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=22, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_752d0310c94b42d3902fffa1070bb1d4, message={"server":"","servicePrincipal":"","db":"default","table":"table_752d0310c94b42d3902fffa1070bb1d4","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_752d0310c94b42d3902fffa1070bb1d4\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219209},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_752d0310c94b42d3902fffa1070bb1d4\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_752d0310c94b42d3902fffa1070bb1d4\",\"kudu.table_id\":\"3b10ed2d37fe46a5b63d646901474c8e\",\"transient_lastDdlTime\":\"1786219209\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1786219212, eventType=CREATE_TABLE, dbName=default, tableName=table_aa0809b208774982934a9f8de43aecf5, message={"server":"","servicePrincipal":"","db":"default","table":"table_aa0809b208774982934a9f8de43aecf5","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_aa0809b208774982934a9f8de43aecf5\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219212},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_aa0809b208774982934a9f8de43aecf5\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_aa0809b208774982934a9f8de43aecf5\",\"kudu.table_id\":\"1ba38449531f437d8795f5e35a3f9479\",\"transient_lastDdlTime\":\"1786219212\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=24, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_4dc166b247ee4cf89cdd926e07b51a51, message={"server":"","servicePrincipal":"","db":"default","table":"table_4dc166b247ee4cf89cdd926e07b51a51","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_4dc166b247ee4cf89cdd926e07b51a51\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219210},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_4dc166b247ee4cf89cdd926e07b51a51\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_4dc166b247ee4cf89cdd926e07b51a51\",\"kudu.table_id\":\"355ea74a32ec4502b6679611e8c8b67e\",\"transient_lastDdlTime\":\"1786219210\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=25, eventTime=1786219212, eventType=CREATE_TABLE, dbName=default, tableName=table_bfc21652528345b883ecf7962d128fee, message={"server":"","servicePrincipal":"","db":"default","table":"table_bfc21652528345b883ecf7962d128fee","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_bfc21652528345b883ecf7962d128fee\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219212},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_bfc21652528345b883ecf7962d128fee\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_bfc21652528345b883ecf7962d128fee\",\"kudu.table_id\":\"95d1dc4138bd491da51e09440dab7eee\",\"transient_lastDdlTime\":\"1786219212\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=26, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_324c660111c84a72a6935eb8e30a7ae6, message={"server":"","servicePrincipal":"","db":"default","table":"table_324c660111c84a72a6935eb8e30a7ae6","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_324c660111c84a72a6935eb8e30a7ae6\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219209},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_324c660111c84a72a6935eb8e30a7ae6\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_324c660111c84a72a6935eb8e30a7ae6\",\"kudu.table_id\":\"06447c1e53ac4366baae14ef41588d7f\",\"transient_lastDdlTime\":\"1786219209\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=27, eventTime=1786219212, eventType=CREATE_TABLE, dbName=default, tableName=table_42e6672ee7be4c4389fcc998d6eb322d, message={"server":"","servicePrincipal":"","db":"default","table":"table_42e6672ee7be4c4389fcc998d6eb322d","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_42e6672ee7be4c4389fcc998d6eb322d\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219212},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_42e6672ee7be4c4389fcc998d6eb322d\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_42e6672ee7be4c4389fcc998d6eb322d\",\"kudu.table_id\":\"67d34c9d2f51445e8cf367f41abbcc28\",\"transient_lastDdlTime\":\"1786219212\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=27, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_5730907850e643b4ac068a85e1574ddf, message={"server":"","servicePrincipal":"","db":"default","table":"table_5730907850e643b4ac068a85e1574ddf","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_5730907850e643b4ac068a85e1574ddf\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219212},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_5730907850e643b4ac068a85e1574ddf\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_5730907850e643b4ac068a85e1574ddf\",\"kudu.table_id\":\"bce1917a27c14330bfe2ccc5dc0b40a3\",\"transient_lastDdlTime\":\"1786219212\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7fbf9e19ed5d google::LogMessage::Fail() at ??:0
@ 0x7fbf9e1a2b23 google::LogMessage::SendToLog() at ??:0
@ 0x7fbf9e19e75c google::LogMessage::Flush() at ??:0
I20260808 20:00:16.380767 22277 master_service.cc:960] ReplaceTablet: received request to replace tablet 553ff75afb1d47d9b48410b8d6fa13dc from {username='slave'} at 127.0.0.1:38088
@ 0x7fbf9e19e9a1 google::LogMessage::~LogMessage() at ??:0
I20260808 20:00:16.383199 22282 master_service.cc:960] ReplaceTablet: received request to replace tablet 3c66d42b171948bba3f76c598b60e858 from {username='slave'} at 127.0.0.1:38088
I20260808 20:00:16.383680 22288 master_service.cc:960] ReplaceTablet: received request to replace tablet 78ab65d40a004ef9888b6577716b783c from {username='slave'} at 127.0.0.1:38088
I20260808 20:00:16.385762 22287 master_service.cc:960] ReplaceTablet: received request to replace tablet 3c66d42b171948bba3f76c598b60e858 from {username='slave'} at 127.0.0.1:38088
I20260808 20:00:16.387671 22283 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38088:
table { table_name: "default.Table_c083bd43fffa4344b41de48e5edd3fd3" } modify_external_catalogs: true
I20260808 20:00:16.387988 22283 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38088:
table { table_name: "default.Table_c083bd43fffa4344b41de48e5edd3fd3" } modify_external_catalogs: true
I20260808 20:00:16.389110 22278 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38088:
table { table_name: "default.Table_1cd24efa52a547cc872dd7ffe4938fb8" } new_table_name: "default.Table_eeef3b0a60b348b7b04564f853ad9db6" modify_external_catalogs: true
@ 0x7fbfb4e67f64 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260808 20:00:16.389568 22284 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38088:
table { table_name: "default.Table_3ffa098d41af4ebb987cec463feb8e76" } new_table_name: "default.Table_7e7179fca77a4eba85afe7296adac113" modify_external_catalogs: true
I20260808 20:00:16.390024 22285 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38088:
name: "default.Table_f5c38573b0784ce8816d5a8a04f841d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:16.393582 22281 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38088:
table { table_name: "default.Table_530ab728450b4272b3e9573534afe4e6" } new_table_name: "default.Table_924eca5df51c4cceb65228505a337698" modify_external_catalogs: true
I20260808 20:00:16.394110 22275 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38088:
table { table_name: "default.Table_4dc166b247ee4cf89cdd926e07b51a51" } modify_external_catalogs: true
I20260808 20:00:16.394318 22275 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38088:
table { table_name: "default.Table_4dc166b247ee4cf89cdd926e07b51a51" } modify_external_catalogs: true
W20260808 20:00:16.397078 22267 consensus_peers.cc:597] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 -> Peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Couldn't send request to peer b91a1a84d6cd4038ac9d3ad2b8cf7979. Status: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
@ 0x7fbfb4e66811 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260808 20:00:16.399376 24221 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 5 FOLLOWER]: Refusing update from remote peer 16a59d796024414abf9f82a7593530a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 93. Preceding OpId from leader: term: 5 index: 95. (index mismatch)
I20260808 20:00:16.400774 24330 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 94, Last known committed idx: 92, Time since last communication: 0.000s
@ 0x7fbfb4e6e48c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7fbfb4e6e309 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaaf86d std::function<>::operator()() at ??:?
I20260808 20:00:16.407693 24341 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16a59d796024414abf9f82a7593530a6. Latest consensus state: current_term: 5 leader_uuid: "16a59d796024414abf9f82a7593530a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:16.408043 24341 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7fbfa0ec6dd9 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fbfa45966db start_thread at ??:0
I20260808 20:00:16.414897 22277 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6: Sending DeleteTablet for 3 replicas of tablet 553ff75afb1d47d9b48410b8d6fa13dc
I20260808 20:00:16.415602 22277 catalog_manager.cc:6807] ReplaceTablet: tablet 553ff75afb1d47d9b48410b8d6fa13dc deleted and replaced by tablet 55e7c93eae77489e9594c52cf22d4e45
@ 0x7fbf9d04d61f clone at ??:0
I20260808 20:00:16.417006 22674 tablet_service.cc:1558] Processing DeleteTablet for tablet 553ff75afb1d47d9b48410b8d6fa13dc with delete_type TABLET_DATA_DELETED (replaced by tablet 55e7c93eae77489e9594c52cf22d4e45) from {username='slave'} at 127.0.0.1:43572
I20260808 20:00:16.417199 22901 tablet_service.cc:1558] Processing DeleteTablet for tablet 553ff75afb1d47d9b48410b8d6fa13dc with delete_type TABLET_DATA_DELETED (replaced by tablet 55e7c93eae77489e9594c52cf22d4e45) from {username='slave'} at 127.0.0.1:58148
I20260808 20:00:16.418519 24341 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "16a59d796024414abf9f82a7593530a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:16.418752 24341 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:16.424252 24355 tablet_replica.cc:333] T 553ff75afb1d47d9b48410b8d6fa13dc P e34d5caee97d44fa945a91ddc6a54653: stopping tablet replica
I20260808 20:00:16.424508 24355 raft_consensus.cc:2243] T 553ff75afb1d47d9b48410b8d6fa13dc P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:16.424775 24355 raft_consensus.cc:2272] T 553ff75afb1d47d9b48410b8d6fa13dc P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:16.424854 24354 tablet_replica.cc:333] T 553ff75afb1d47d9b48410b8d6fa13dc P 257c9c7e0c6c441593eac06beb31fa4e: stopping tablet replica
I20260808 20:00:16.425107 24354 raft_consensus.cc:2243] T 553ff75afb1d47d9b48410b8d6fa13dc P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:16.425410 24354 raft_consensus.cc:2272] T 553ff75afb1d47d9b48410b8d6fa13dc P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:16.425467 24355 ts_tablet_manager.cc:1916] T 553ff75afb1d47d9b48410b8d6fa13dc P e34d5caee97d44fa945a91ddc6a54653: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:16.427675 24354 ts_tablet_manager.cc:1916] T 553ff75afb1d47d9b48410b8d6fa13dc P 257c9c7e0c6c441593eac06beb31fa4e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:16.432304 24354 ts_tablet_manager.cc:1929] T 553ff75afb1d47d9b48410b8d6fa13dc P 257c9c7e0c6c441593eac06beb31fa4e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 20:00:16.432415 24354 log.cc:1199] T 553ff75afb1d47d9b48410b8d6fa13dc P 257c9c7e0c6c441593eac06beb31fa4e: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-0/wal/wals/553ff75afb1d47d9b48410b8d6fa13dc
I20260808 20:00:16.432560 24355 ts_tablet_manager.cc:1929] T 553ff75afb1d47d9b48410b8d6fa13dc P e34d5caee97d44fa945a91ddc6a54653: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 20:00:16.432691 24355 log.cc:1199] T 553ff75afb1d47d9b48410b8d6fa13dc P e34d5caee97d44fa945a91ddc6a54653: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/wal/wals/553ff75afb1d47d9b48410b8d6fa13dc
I20260808 20:00:16.432758 24354 ts_tablet_manager.cc:1950] T 553ff75afb1d47d9b48410b8d6fa13dc P 257c9c7e0c6c441593eac06beb31fa4e: Deleting consensus metadata
I20260808 20:00:16.433142 24355 ts_tablet_manager.cc:1950] T 553ff75afb1d47d9b48410b8d6fa13dc P e34d5caee97d44fa945a91ddc6a54653: Deleting consensus metadata
I20260808 20:00:16.463344 24367 ts_tablet_manager.cc:933] T 1f1032c7852540c9bda3a1c37cd4bc9f P 257c9c7e0c6c441593eac06beb31fa4e: Initiating tablet copy from peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:16.464514 24367 tablet_copy_client.cc:323] T 1f1032c7852540c9bda3a1c37cd4bc9f P 257c9c7e0c6c441593eac06beb31fa4e: tablet copy: Beginning tablet copy session from remote peer at address 127.21.36.66:46229
I20260808 20:00:16.466115 22970 tablet_copy_service.cc:140] P e34d5caee97d44fa945a91ddc6a54653: Received BeginTabletCopySession request for tablet 1f1032c7852540c9bda3a1c37cd4bc9f from peer 257c9c7e0c6c441593eac06beb31fa4e ({username='slave'} at 127.21.36.65:57889)
I20260808 20:00:16.466369 22970 tablet_copy_service.cc:161] P e34d5caee97d44fa945a91ddc6a54653: Beginning new tablet copy session on tablet 1f1032c7852540c9bda3a1c37cd4bc9f from peer 257c9c7e0c6c441593eac06beb31fa4e at {username='slave'} at 127.21.36.65:57889: session id = 257c9c7e0c6c441593eac06beb31fa4e-1f1032c7852540c9bda3a1c37cd4bc9f
I20260808 20:00:16.469969 22970 tablet_copy_source_session.cc:215] T 1f1032c7852540c9bda3a1c37cd4bc9f P e34d5caee97d44fa945a91ddc6a54653: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 20:00:16.472357 24367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f1032c7852540c9bda3a1c37cd4bc9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:16.477823 24367 tablet_copy_client.cc:806] T 1f1032c7852540c9bda3a1c37cd4bc9f P 257c9c7e0c6c441593eac06beb31fa4e: tablet copy: Starting download of 0 data blocks...
I20260808 20:00:16.478238 24367 tablet_copy_client.cc:670] T 1f1032c7852540c9bda3a1c37cd4bc9f P 257c9c7e0c6c441593eac06beb31fa4e: tablet copy: Starting download of 1 WAL segments...
I20260808 20:00:16.481081 24367 tablet_copy_client.cc:538] T 1f1032c7852540c9bda3a1c37cd4bc9f P 257c9c7e0c6c441593eac06beb31fa4e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 20:00:16.485419 24367 tablet_bootstrap.cc:492] T 1f1032c7852540c9bda3a1c37cd4bc9f P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:16.492906 24367 tablet_bootstrap.cc:492] T 1f1032c7852540c9bda3a1c37cd4bc9f P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 20:00:16.493425 24367 tablet_bootstrap.cc:492] T 1f1032c7852540c9bda3a1c37cd4bc9f P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap complete.
I20260808 20:00:16.493717 24367 ts_tablet_manager.cc:1403] T 1f1032c7852540c9bda3a1c37cd4bc9f P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.008s user 0.008s sys 0.000s
I20260808 20:00:16.494633 24367 raft_consensus.cc:359] T 1f1032c7852540c9bda3a1c37cd4bc9f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:16.494865 24367 raft_consensus.cc:740] T 1f1032c7852540c9bda3a1c37cd4bc9f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:16.495162 24367 consensus_queue.cc:260] T 1f1032c7852540c9bda3a1c37cd4bc9f P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:16.496042 24367 ts_tablet_manager.cc:1434] T 1f1032c7852540c9bda3a1c37cd4bc9f P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20260808 20:00:16.498598 22970 tablet_copy_service.cc:342] P e34d5caee97d44fa945a91ddc6a54653: Request end of tablet copy session 257c9c7e0c6c441593eac06beb31fa4e-1f1032c7852540c9bda3a1c37cd4bc9f received from {username='slave'} at 127.21.36.65:57889
I20260808 20:00:16.498847 22970 tablet_copy_service.cc:434] P e34d5caee97d44fa945a91ddc6a54653: ending tablet copy session 257c9c7e0c6c441593eac06beb31fa4e-1f1032c7852540c9bda3a1c37cd4bc9f on tablet 1f1032c7852540c9bda3a1c37cd4bc9f with peer 257c9c7e0c6c441593eac06beb31fa4e
W20260808 20:00:16.621124 22604 connection.cc:573] server connection from 127.0.0.1:43572 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 20:00:16.621361 24179 connection.cc:573] server connection from 127.0.0.1:45952 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 20:00:16.621387 22604 connection.cc:573] client connection to 127.21.36.125:36441 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 20:00:16.621742 23273 connection.cc:573] client connection to 127.21.36.125:36441 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 20:00:16.622375 22832 connection.cc:573] server connection from 127.0.0.1:58148 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 20:00:16.622440 23273 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.21.36.125:36441)
W20260808 20:00:16.622709 23273 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.21.36.125:36441)
W20260808 20:00:16.622707 23066 connection.cc:573] client connection to 127.21.36.125:36441 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 20:00:16.622917 23273 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.21.36.125:36441)
W20260808 20:00:16.623322 23273 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.21.36.125:36441)
I20260808 20:00:16.689080 24078 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:00:16.689373 24078 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:16.690160 24078 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:00:16.691277 22607 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
W20260808 20:00:16.691570 22604 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:00:16.691713 22604 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:00:16.692049 24078 raft_consensus.cc:2749] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:00:16.844264 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 1: this message will repeat every 5th retry.
I20260808 20:00:16.909983 24078 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:00:16.910223 24078 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:16.910971 24078 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:00:16.912019 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:00:16.912220 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:00:16.912333 22604 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:00:16.912642 24078 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:00:16.914108 24341 raft_consensus.cc:493] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 16a59d796024414abf9f82a7593530a6)
I20260808 20:00:16.914302 24341 raft_consensus.cc:515] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:16.916107 24341 leader_election.cc:290] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:00:16.916981 24179 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
W20260808 20:00:16.918305 24181 leader_election.cc:336] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:00:16.918516 24179 leader_election.cc:336] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441): Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
I20260808 20:00:16.918649 24179 leader_election.cc:304] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2c4576401a74a60855647c956b195fd; no voters: 16a59d796024414abf9f82a7593530a6, b91a1a84d6cd4038ac9d3ad2b8cf7979
I20260808 20:00:16.919015 24341 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260808 20:00:16.924787 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 1: this message will repeat every 5th retry.
I20260808 20:00:17.364873 22710 raft_consensus.cc:1217] T 1f1032c7852540c9bda3a1c37cd4bc9f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260808 20:00:17.594350 24392 raft_consensus.cc:493] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 16a59d796024414abf9f82a7593530a6)
I20260808 20:00:17.594558 24392 raft_consensus.cc:515] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:17.595379 24392 leader_election.cc:290] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:00:17.597878 24179 leader_election.cc:336] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441): Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
W20260808 20:00:17.598068 24181 leader_election.cc:336] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:00:17.598275 24181 leader_election.cc:304] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2c4576401a74a60855647c956b195fd; no voters: 16a59d796024414abf9f82a7593530a6, b91a1a84d6cd4038ac9d3ad2b8cf7979
I20260808 20:00:17.598583 24392 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260808 20:00:18.392800 24423 raft_consensus.cc:493] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 16a59d796024414abf9f82a7593530a6)
I20260808 20:00:18.392994 24423 raft_consensus.cc:515] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:18.393709 24423 leader_election.cc:290] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:00:18.395881 24179 leader_election.cc:336] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441): Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
W20260808 20:00:18.396085 24181 leader_election.cc:336] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:00:18.396230 24181 leader_election.cc:304] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2c4576401a74a60855647c956b195fd; no voters: 16a59d796024414abf9f82a7593530a6, b91a1a84d6cd4038ac9d3ad2b8cf7979
I20260808 20:00:18.396585 24423 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260808 20:00:18.571216 21649 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu
/tmp/dist-test-taskNcG5N9/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.36.124:34593
--webserver_interface=127.21.36.124
--webserver_port=40825
--builtin_ntp_servers=127.21.36.84:34883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593
--hive_metastore_uris=thrift://127.0.0.1:44789
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260808 20:00:18.939829 24435 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 20:00:18.940186 24435 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 20:00:18.940296 24435 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260808 20:00:18.949050 24435 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 20:00:18.949174 24435 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260808 20:00:18.949256 24435 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 20:00:18.949327 24435 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260808 20:00:18.960042 24435 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.36.84:34883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:44789
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.36.124:34593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.21.36.124
--webserver_port=40825
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 08 Aug 2026 19:43:23 UTC on bdcb31816ec0
build id 13246
ASAN enabled
I20260808 20:00:18.961719 24435 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 20:00:18.963716 24435 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 20:00:18.972499 24451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 20:00:18.972534 24452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 20:00:18.973520 24457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 20:00:18.974779 24435 server_base.cc:1061] running on GCE node
I20260808 20:00:18.975797 24435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 20:00:18.977473 24435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 20:00:18.978677 24435 hybrid_clock.cc:648] HybridClock initialized: now 1786219218978608 us; error 60 us; skew 500 ppm
I20260808 20:00:18.979082 24435 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 20:00:18.981513 24435 webserver.cc:533] Webserver started at http://127.21.36.124:40825/ using document root <none> and password file <none>
I20260808 20:00:18.982337 24435 fs_manager.cc:362] Metadata directory not provided
I20260808 20:00:18.982455 24435 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 20:00:18.988576 24435 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 20:00:18.991729 24469 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 20:00:18.993187 24435 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 20:00:18.993348 24435 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/data,/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/wal
uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979"
format_stamp: "Formatted at 2026-08-08 20:00:05 on dist-test-slave-pww0"
I20260808 20:00:18.994093 24435 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 20:00:19.020116 24435 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 20:00:19.021073 24435 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 20:00:19.021384 24435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 20:00:19.043519 24435 rpc_server.cc:307] RPC server started. Bound to: 127.21.36.124:34593
I20260808 20:00:19.043515 24548 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.36.124:34593 every 8 connection(s)
I20260808 20:00:19.045295 24435 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/data/info.pb
I20260808 20:00:19.048233 21649 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu as pid 24435
I20260808 20:00:19.054046 24549 sys_catalog.cc:263] Verifying existing consensus state
I20260808 20:00:19.058415 24549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: Bootstrap starting.
I20260808 20:00:19.077113 24549 log.cc:826] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: Log is configured to *not* fsync() on all Append() calls
I20260808 20:00:19.149803 24549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: Bootstrap replayed 1/1 log segments. Stats: ops{read=87 overwritten=0 applied=87 ignored=0} inserts{seen=58 ignored=0} mutations{seen=64 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 20:00:19.150424 24549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: Bootstrap complete.
I20260808 20:00:19.156653 24549 raft_consensus.cc:359] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:19.157452 24549 raft_consensus.cc:740] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: b91a1a84d6cd4038ac9d3ad2b8cf7979, State: Initialized, Role: FOLLOWER
I20260808 20:00:19.158164 24549 consensus_queue.cc:260] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 87, Last appended: 3.87, Last appended by leader: 87, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:19.159081 24553 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:19.159405 24553 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:19.160140 24549 sys_catalog.cc:565] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 20:00:19.187393 24577 catalog_manager.cc:1295] Loaded cluster ID: 9c4ad126d38943188e9e4422f5e27418
I20260808 20:00:19.187592 24577 catalog_manager.cc:1588] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: loading cluster ID for follower catalog manager: success
I20260808 20:00:19.192631 24577 catalog_manager.cc:1610] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: acquiring CA information for follower catalog manager: success
I20260808 20:00:19.196167 24577 catalog_manager.cc:1638] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 20:00:19.202857 24435 master_runner.cc:187] Error getting master registration for 127.21.36.125:36441: Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111),
I20260808 20:00:19.206902 24435 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:00:19.358170 23254 heartbeater.cc:344] Connected to a master server at 127.21.36.124:34593
I20260808 20:00:19.362046 24498 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" instance_seqno: 1786219208132788) as {username='slave'} at 127.21.36.67:48879; Asking this server to re-register.
I20260808 20:00:19.363042 23254 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:19.365154 24498 ts_manager.cc:194] Registered new tserver with Master: 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:19.384408 23016 heartbeater.cc:344] Connected to a master server at 127.21.36.124:34593
I20260808 20:00:19.387547 24498 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" instance_seqno: 1786219207598982) as {username='slave'} at 127.21.36.66:60421; Asking this server to re-register.
I20260808 20:00:19.388573 23016 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:19.390573 24498 ts_manager.cc:194] Registered new tserver with Master: e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:19.419698 22791 heartbeater.cc:344] Connected to a master server at 127.21.36.124:34593
I20260808 20:00:19.421993 24595 raft_consensus.cc:493] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 16a59d796024414abf9f82a7593530a6)
I20260808 20:00:19.422288 24498 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" instance_seqno: 1786219207065397) as {username='slave'} at 127.21.36.65:33817; Asking this server to re-register.
I20260808 20:00:19.422222 24595 raft_consensus.cc:515] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:19.423132 24595 leader_election.cc:290] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
I20260808 20:00:19.423226 22791 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:19.425390 24498 ts_manager.cc:194] Registered new tserver with Master: 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923)
W20260808 20:00:19.428442 24179 leader_election.cc:336] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441): Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
I20260808 20:00:19.432968 24511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d2c4576401a74a60855647c956b195fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 97 } } ignore_live_leader: false dest_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" is_pre_election: true
I20260808 20:00:19.433712 24511 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2c4576401a74a60855647c956b195fd in term 3.
I20260808 20:00:19.434379 24181 leader_election.cc:304] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd; no voters: 16a59d796024414abf9f82a7593530a6
I20260808 20:00:19.434940 24595 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260808 20:00:19.435088 24595 raft_consensus.cc:493] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 16a59d796024414abf9f82a7593530a6)
I20260808 20:00:19.435200 24595 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 5 FOLLOWER]: Advancing to term 6
I20260808 20:00:19.437448 24595 raft_consensus.cc:515] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:19.438148 24595 leader_election.cc:290] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 6 election: Requested vote from peers 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
I20260808 20:00:19.438951 24511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d2c4576401a74a60855647c956b195fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 97 } } ignore_live_leader: false dest_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979"
I20260808 20:00:19.439193 24511 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 3 FOLLOWER]: Advancing to term 6
W20260808 20:00:19.439719 24179 leader_election.cc:336] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441): Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
I20260808 20:00:19.445359 24511 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2c4576401a74a60855647c956b195fd in term 6.
I20260808 20:00:19.446025 24181 leader_election.cc:304] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd; no voters: 16a59d796024414abf9f82a7593530a6
I20260808 20:00:19.446420 24595 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 6 FOLLOWER]: Leader election won for term 6
I20260808 20:00:19.446895 24595 raft_consensus.cc:697] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 6 LEADER]: Becoming Leader. State: Replica: d2c4576401a74a60855647c956b195fd, State: Running, Role: LEADER
I20260808 20:00:19.447383 24595 consensus_queue.cc:237] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 97, Committed index: 97, Last appended: 5.97, Last appended by leader: 97, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:19.449275 24600 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2c4576401a74a60855647c956b195fd. Latest consensus state: current_term: 6 leader_uuid: "d2c4576401a74a60855647c956b195fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:19.449625 24600 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: This master's current role is: LEADER
I20260808 20:00:19.450337 24602 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 20:00:19.453240 24602 catalog_manager.cc:679] Loaded metadata for table default.table_f7a6e8903ed74dc088eb1f490788c54b [id=0145ea517a7a4aec99304181d1c6cb28]
I20260808 20:00:19.453761 24602 catalog_manager.cc:679] Loaded metadata for table default.table_324c660111c84a72a6935eb8e30a7ae6 [id=06447c1e53ac4366baae14ef41588d7f]
I20260808 20:00:19.454186 24602 catalog_manager.cc:679] Loaded metadata for table default.table_61bf42c8286347d197162895f70520d7 [id=08230c16ec604c259195bbfa0c062164]
I20260808 20:00:19.454566 24602 catalog_manager.cc:679] Loaded metadata for table default.table_3ffa098d41af4ebb987cec463feb8e76 [id=1042ec7801c740c09255102bf01b8fd2]
I20260808 20:00:19.455003 24602 catalog_manager.cc:679] Loaded metadata for table default.table_4dc166b247ee4cf89cdd926e07b51a51 [id=355ea74a32ec4502b6679611e8c8b67e]
I20260808 20:00:19.455665 24602 catalog_manager.cc:679] Loaded metadata for table default.table_752d0310c94b42d3902fffa1070bb1d4 [id=3b10ed2d37fe46a5b63d646901474c8e]
I20260808 20:00:19.456027 24602 catalog_manager.cc:679] Loaded metadata for table default.table_4ed5029dcfbd499db24fb72e6b389d42 [id=43498092c52a457d93f97ba0993e6012]
I20260808 20:00:19.456450 24602 catalog_manager.cc:679] Loaded metadata for table default.table_732a1b16caff489aa844bba46e6ec1cb [id=524bfe483c7f4c4d99d2757ff290c5eb]
I20260808 20:00:19.456807 24602 catalog_manager.cc:679] Loaded metadata for table default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528]
I20260808 20:00:19.457165 24602 catalog_manager.cc:679] Loaded metadata for table default.table_42e6672ee7be4c4389fcc998d6eb322d [id=67d34c9d2f51445e8cf367f41abbcc28]
I20260808 20:00:19.457494 24602 catalog_manager.cc:679] Loaded metadata for table default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619]
I20260808 20:00:19.457855 24602 catalog_manager.cc:679] Loaded metadata for table default.table_1cd24efa52a547cc872dd7ffe4938fb8 [id=87fca666b411494c8486baf1bfa58327]
I20260808 20:00:19.458170 24602 catalog_manager.cc:679] Loaded metadata for table default.table_5a92fa3792a1443f94a707060264359c [id=89520ebff12347f18df06b25577ecf63]
I20260808 20:00:19.458495 24602 catalog_manager.cc:679] Loaded metadata for table default.table_530ab728450b4272b3e9573534afe4e6 [id=8c917809771f4262811b9f200ff0e925]
I20260808 20:00:19.458840 24602 catalog_manager.cc:679] Loaded metadata for table default.table_583f1fdac11148488799008b032f7ef2 [id=99b11a3c5ca3411b8c1800c70f61597a]
I20260808 20:00:19.459177 24602 catalog_manager.cc:679] Loaded metadata for table default.table_831d17f2742e4fb8bc727d56fc9d1c85 [id=b47087e2cd6349b1ba2b8daf55b2d1d5]
I20260808 20:00:19.459540 24602 catalog_manager.cc:679] Loaded metadata for table default.table_ba9e157aaf3a487eb4f3f2ec9c37b761 [id=edaf172891fe4dafbc1b00bbb27d9c1c]
I20260808 20:00:19.459894 24602 catalog_manager.cc:679] Loaded metadata for table default.table_01314a1f924d4e33bdecf8797a6e2e0a [id=fb4aaf09a463481d9f5512884b9574d7]
I20260808 20:00:19.461897 24602 tablet_loader.cc:96] loaded metadata for tablet 052275c6e1d34d9d9242718b4e803b48 (table default.table_f7a6e8903ed74dc088eb1f490788c54b [id=0145ea517a7a4aec99304181d1c6cb28])
I20260808 20:00:19.462497 24602 tablet_loader.cc:96] loaded metadata for tablet 1f1032c7852540c9bda3a1c37cd4bc9f (table default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619])
I20260808 20:00:19.462843 24602 tablet_loader.cc:96] loaded metadata for tablet 2086c55bb74a4997bcc9a49205ecf0f5 (table default.table_01314a1f924d4e33bdecf8797a6e2e0a [id=fb4aaf09a463481d9f5512884b9574d7])
I20260808 20:00:19.463189 24602 tablet_loader.cc:96] loaded metadata for tablet 2523719318f84e31862e40d76f9a23f5 (table default.table_5a92fa3792a1443f94a707060264359c [id=89520ebff12347f18df06b25577ecf63])
I20260808 20:00:19.463512 24602 tablet_loader.cc:96] loaded metadata for tablet 27b71167912a4250a58941600e22488e (table default.table_583f1fdac11148488799008b032f7ef2 [id=99b11a3c5ca3411b8c1800c70f61597a])
I20260808 20:00:19.463871 24602 tablet_loader.cc:96] loaded metadata for tablet 286e98ffe9b44ada92fd8e9776578df2 (table default.table_732a1b16caff489aa844bba46e6ec1cb [id=524bfe483c7f4c4d99d2757ff290c5eb])
I20260808 20:00:19.464316 24602 tablet_loader.cc:96] loaded metadata for tablet 308609a3a4504bb5902009fd82d0775b (table default.table_1cd24efa52a547cc872dd7ffe4938fb8 [id=87fca666b411494c8486baf1bfa58327])
I20260808 20:00:19.465061 24602 tablet_loader.cc:96] loaded metadata for tablet 55cf64ca16df4afbae5f58843f613f27 (table default.table_530ab728450b4272b3e9573534afe4e6 [id=8c917809771f4262811b9f200ff0e925])
I20260808 20:00:19.465317 24602 tablet_loader.cc:96] loaded metadata for tablet 55e7c93eae77489e9594c52cf22d4e45 (table default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528])
I20260808 20:00:19.465623 24602 tablet_loader.cc:96] loaded metadata for tablet 57c91cdb20e74754b418cbc9af674632 (table default.table_42e6672ee7be4c4389fcc998d6eb322d [id=67d34c9d2f51445e8cf367f41abbcc28])
I20260808 20:00:19.465950 24602 tablet_loader.cc:96] loaded metadata for tablet 5d0d61aef7854aa49fe36f2f505207b7 (table default.table_4dc166b247ee4cf89cdd926e07b51a51 [id=355ea74a32ec4502b6679611e8c8b67e])
I20260808 20:00:19.466583 24602 tablet_loader.cc:96] loaded metadata for tablet 746ad131d3534fedb10eef21b4bd23ee (table default.table_61bf42c8286347d197162895f70520d7 [id=08230c16ec604c259195bbfa0c062164])
I20260808 20:00:19.467322 24602 tablet_loader.cc:96] loaded metadata for tablet 9b63e4c056f34242aacef5ffafb14b25 (table default.table_ba9e157aaf3a487eb4f3f2ec9c37b761 [id=edaf172891fe4dafbc1b00bbb27d9c1c])
I20260808 20:00:19.468011 24602 tablet_loader.cc:96] loaded metadata for tablet b45729e2ec9e4a77b8be89f9657b0424 (table default.table_4ed5029dcfbd499db24fb72e6b389d42 [id=43498092c52a457d93f97ba0993e6012])
I20260808 20:00:19.468304 24602 tablet_loader.cc:96] loaded metadata for tablet b8948ef8ed844727b9fed1e91d9233f6 (table default.table_324c660111c84a72a6935eb8e30a7ae6 [id=06447c1e53ac4366baae14ef41588d7f])
I20260808 20:00:19.468602 24602 tablet_loader.cc:96] loaded metadata for tablet c75913753d95447783b9b7c7bb6ee701 (table default.table_752d0310c94b42d3902fffa1070bb1d4 [id=3b10ed2d37fe46a5b63d646901474c8e])
I20260808 20:00:19.468899 24602 tablet_loader.cc:96] loaded metadata for tablet d1c720d7dc8e4b8184ffc863a22cf9e3 (table default.table_831d17f2742e4fb8bc727d56fc9d1c85 [id=b47087e2cd6349b1ba2b8daf55b2d1d5])
I20260808 20:00:19.469499 24602 tablet_loader.cc:96] loaded metadata for tablet e18581438df6444e98c94b958a31650c (table default.table_3ffa098d41af4ebb987cec463feb8e76 [id=1042ec7801c740c09255102bf01b8fd2])
I20260808 20:00:19.469794 24602 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 20:00:19.471310 24602 catalog_manager.cc:1295] Loaded cluster ID: 9c4ad126d38943188e9e4422f5e27418
I20260808 20:00:19.471402 24602 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 20:00:19.472988 24602 catalog_manager.cc:1540] Loading token signing keys...
I20260808 20:00:19.474476 24602 catalog_manager.cc:6103] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Loaded TSK: 0
I20260808 20:00:19.475728 24602 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 20:00:19.476886 24602 catalog_manager.cc:1563] Loading latest processed Hive Metastore notification log event ID...
I20260808 20:00:19.478842 24602 catalog_manager.cc:5941] Last processed Hive Metastore notification event ID: 20
I20260808 20:00:19.563697 24209 master_service.cc:960] ReplaceTablet: received request to replace tablet 746ad131d3534fedb10eef21b4bd23ee from {username='slave'} at 127.0.0.1:45924
I20260808 20:00:19.565338 24203 master_service.cc:960] ReplaceTablet: received request to replace tablet d1c720d7dc8e4b8184ffc863a22cf9e3 from {username='slave'} at 127.0.0.1:45924
I20260808 20:00:19.568014 24207 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45924:
table { table_name: "default.Table_4ed5029dcfbd499db24fb72e6b389d42" } new_table_name: "default.Table_a9d94ade99394dc6b742a534c91da3bd" modify_external_catalogs: true
I20260808 20:00:19.567184 24198 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45924:
name: "default.Table_4390d242408442d790a0662898378018"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:19.568578 24195 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45924:
name: "default.Table_bfc21652528345b883ecf7962d128fee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:19.568051 24197 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45924:
name: "default.Table_5730907850e643b4ac068a85e1574ddf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:19.568351 24205 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45924:
table { table_name: "default.Table_324c660111c84a72a6935eb8e30a7ae6" } modify_external_catalogs: true
I20260808 20:00:19.568403 24201 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45924:
table { table_name: "default.Table_46d148afc6d142a0855d47f765b25297" } modify_external_catalogs: true
I20260808 20:00:19.573307 24200 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45924:
name: "default.Table_b7b099db34ef495387d5650e289948e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:19.573191 24201 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45924:
table { table_name: "default.Table_46d148afc6d142a0855d47f765b25297" } modify_external_catalogs: true
I20260808 20:00:19.574218 24205 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45924:
table { table_name: "default.Table_324c660111c84a72a6935eb8e30a7ae6" } modify_external_catalogs: true
I20260808 20:00:19.572683 24196 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45924:
name: "default.Table_aa0809b208774982934a9f8de43aecf5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 20:00:19.580467 24179 consensus_peers.cc:597] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd -> Peer 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441): Couldn't send request to peer 16a59d796024414abf9f82a7593530a6. Status: Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 20:00:19.580605 24511 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 6 FOLLOWER]: Refusing update from remote peer d2c4576401a74a60855647c956b195fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 87. Preceding OpId from leader: term: 6 index: 99. (index mismatch)
I20260808 20:00:19.581496 24600 consensus_queue.cc:1048] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 98, Last known committed idx: 87, Time since last communication: 0.000s
F20260808 20:00:19.589073 24299 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 27, previous 27; dumping first 8 out of 15 received events: NotificationEvent(eventId=21, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_831d17f2742e4fb8bc727d56fc9d1c85, message={"server":"","servicePrincipal":"","db":"default","table":"table_831d17f2742e4fb8bc727d56fc9d1c85","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_831d17f2742e4fb8bc727d56fc9d1c85\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219209},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_831d17f2742e4fb8bc727d56fc9d1c85\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_831d17f2742e4fb8bc727d56fc9d1c85\",\"kudu.table_id\":\"b47087e2cd6349b1ba2b8daf55b2d1d5\",\"transient_lastDdlTime\":\"1786219209\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=22, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_752d0310c94b42d3902fffa1070bb1d4, message={"server":"","servicePrincipal":"","db":"default","table":"table_752d0310c94b42d3902fffa1070bb1d4","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_752d0310c94b42d3902fffa1070bb1d4\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219209},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_752d0310c94b42d3902fffa1070bb1d4\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_752d0310c94b42d3902fffa1070bb1d4\",\"kudu.table_id\":\"3b10ed2d37fe46a5b63d646901474c8e\",\"transient_lastDdlTime\":\"1786219209\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1786219212, eventType=CREATE_TABLE, dbName=default, tableName=table_aa0809b208774982934a9f8de43aecf5, message={"server":"","servicePrincipal":"","db":"default","table":"table_aa0809b208774982934a9f8de43aecf5","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_aa0809b208774982934a9f8de43aecf5\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219212},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_aa0809b208774982934a9f8de43aecf5\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_aa0809b208774982934a9f8de43aecf5\",\"kudu.table_id\":\"1ba38449531f437d8795f5e35a3f9479\",\"transient_lastDdlTime\":\"1786219212\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=24, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_4dc166b247ee4cf89cdd926e07b51a51, message={"server":"","servicePrincipal":"","db":"default","table":"table_4dc166b247ee4cf89cdd926e07b51a51","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_4dc166b247ee4cf89cdd926e07b51a51\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219210},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_4dc166b247ee4cf89cdd926e07b51a51\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_4dc166b247ee4cf89cdd926e07b51a51\",\"kudu.table_id\":\"355ea74a32ec4502b6679611e8c8b67e\",\"transient_lastDdlTime\":\"1786219210\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=25, eventTime=1786219212, eventType=CREATE_TABLE, dbName=default, tableName=table_bfc21652528345b883ecf7962d128fee, message={"server":"","servicePrincipal":"","db":"default","table":"table_bfc21652528345b883ecf7962d128fee","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_bfc21652528345b883ecf7962d128fee\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219212},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_bfc21652528345b883ecf7962d128fee\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_bfc21652528345b883ecf7962d128fee\",\"kudu.table_id\":\"95d1dc4138bd491da51e09440dab7eee\",\"transient_lastDdlTime\":\"1786219212\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=26, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_324c660111c84a72a6935eb8e30a7ae6, message={"server":"","servicePrincipal":"","db":"default","table":"table_324c660111c84a72a6935eb8e30a7ae6","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_324c660111c84a72a6935eb8e30a7ae6\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219209},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_324c660111c84a72a6935eb8e30a7ae6\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_324c660111c84a72a6935eb8e30a7ae6\",\"kudu.table_id\":\"06447c1e53ac4366baae14ef41588d7f\",\"transient_lastDdlTime\":\"1786219209\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=27, eventTime=1786219212, eventType=CREATE_TABLE, dbName=default, tableName=table_42e6672ee7be4c4389fcc998d6eb322d, message={"server":"","servicePrincipal":"","db":"default","table":"table_42e6672ee7be4c4389fcc998d6eb322d","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_42e6672ee7be4c4389fcc998d6eb322d\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219212},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_42e6672ee7be4c4389fcc998d6eb322d\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_42e6672ee7be4c4389fcc998d6eb322d\",\"kudu.table_id\":\"67d34c9d2f51445e8cf367f41abbcc28\",\"transient_lastDdlTime\":\"1786219212\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=27, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_5730907850e643b4ac068a85e1574ddf, message={"server":"","servicePrincipal":"","db":"default","table":"table_5730907850e643b4ac068a85e1574ddf","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_5730907850e643b4ac068a85e1574ddf\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219212},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_5730907850e643b4ac068a85e1574ddf\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_5730907850e643b4ac068a85e1574ddf\",\"kudu.table_id\":\"bce1917a27c14330bfe2ccc5dc0b40a3\",\"transient_lastDdlTime\":\"1786219212\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7f9dfd5fbd5d google::LogMessage::Fail() at ??:0
@ 0x7f9dfd5ffb23 google::LogMessage::SendToLog() at ??:0
@ 0x7f9dfd5fb75c google::LogMessage::Flush() at ??:0
@ 0x7f9dfd5fb9a1 google::LogMessage::~LogMessage() at ??:0
@ 0x7f9e142c4f64 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f9e142c3811 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260808 20:00:19.611853 24553 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2c4576401a74a60855647c956b195fd. Latest consensus state: current_term: 6 leader_uuid: "d2c4576401a74a60855647c956b195fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:19.612146 24553 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:19.612543 24612 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "d2c4576401a74a60855647c956b195fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:19.612828 24612 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:19.613921 24615 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "d2c4576401a74a60855647c956b195fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:19.614225 24615 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:19.615242 24604 mvcc.cc:204] Tried to move back new op lower bound from 7316353923373801472 to 7316353922860265472. Current Snapshot: MvccSnapshot[applied={T|T < 7316353923373801472}]
I20260808 20:00:19.616880 24615 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "d2c4576401a74a60855647c956b195fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:19.617051 24615 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:19.622099 24605 mvcc.cc:204] Tried to move back new op lower bound from 7316353923386195968 to 7316353900539645952. Current Snapshot: MvccSnapshot[applied={T|T < 7316353923386195968 or (T in {7316353923386195968})}]
@ 0x7f9e142cb48c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260808 20:00:19.623749 24209 catalog_manager.cc:6006] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Sending DeleteTablet for 3 replicas of tablet 746ad131d3534fedb10eef21b4bd23ee
I20260808 20:00:19.625883 24209 catalog_manager.cc:6807] ReplaceTablet: tablet 746ad131d3534fedb10eef21b4bd23ee deleted and replaced by tablet a065666fbe014e339992f3d0e4cb18d2
@ 0x7f9e142cb309 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaaf86d std::function<>::operator()() at ??:?
@ 0x7f9e00323dd9 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f9e039f36db start_thread at ??:0
@ 0x7f9dfc4aa61f clone at ??:0
W20260808 20:00:19.837059 24623 negotiation.cc:336] Failed RPC negotiation. Trace:
0808 20:00:19.628172 (+ 0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:59510 (local address 127.21.36.67:43047)
0808 20:00:19.641134 (+ 12962us) server_negotiation.cc:207] Beginning negotiation
0808 20:00:19.641142 (+ 8us) server_negotiation.cc:400] Waiting for connection header
0808 20:00:19.641173 (+ 31us) server_negotiation.cc:408] Connection header received
0808 20:00:19.641291 (+ 118us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0808 20:00:19.641299 (+ 8us) server_negotiation.cc:462] Received NEGOTIATE request from client
0808 20:00:19.641407 (+ 108us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0808 20:00:19.641561 (+ 154us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
0808 20:00:19.836733 (+195172us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59510: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":12815,"thread_start_us":12663,"threads_started":1}
W20260808 20:00:19.837639 23276 connection.cc:573] client connection to 127.21.36.126:43945 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 20:00:19.837708 24624 negotiation.cc:336] Failed RPC negotiation. Trace:
0808 20:00:19.628377 (+ 0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:54432 (local address 127.21.36.65:39923)
0808 20:00:19.642935 (+ 14558us) server_negotiation.cc:207] Beginning negotiation
0808 20:00:19.642942 (+ 7us) server_negotiation.cc:400] Waiting for connection header
0808 20:00:19.643040 (+ 98us) server_negotiation.cc:408] Connection header received
0808 20:00:19.643144 (+ 104us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0808 20:00:19.643150 (+ 6us) server_negotiation.cc:462] Received NEGOTIATE request from client
0808 20:00:19.643260 (+ 110us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0808 20:00:19.643396 (+ 136us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
0808 20:00:19.836752 (+193356us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54432: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":14432,"thread_start_us":14273,"threads_started":1}
W20260808 20:00:19.837040 24622 negotiation.cc:336] Failed RPC negotiation. Trace:
0808 20:00:19.627832 (+ 0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:37476 (local address 127.21.36.66:46229)
0808 20:00:19.642219 (+ 14387us) server_negotiation.cc:207] Beginning negotiation
0808 20:00:19.642225 (+ 6us) server_negotiation.cc:400] Waiting for connection header
0808 20:00:19.836672 (+194447us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37476: BlockingRecv error: recv got EOF from 127.0.0.1:37476 (error 108)
Metrics: {"server-negotiator.queue_time_us":14270,"thread_start_us":14118,"threads_started":1}
W20260808 20:00:19.838421 23276 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.21.36.126:43945)
W20260808 20:00:19.839010 23276 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.21.36.126:43945)
W20260808 20:00:19.839215 23276 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.21.36.126:43945)
W20260808 20:00:19.839679 23276 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.21.36.126:43945)
I20260808 20:00:20.117825 24658 raft_consensus.cc:493] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d2c4576401a74a60855647c956b195fd)
I20260808 20:00:20.118045 24658 raft_consensus.cc:515] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:20.120318 24658 leader_election.cc:290] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441)
W20260808 20:00:20.121228 24472 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:00:20.122651 24472 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:00:20.122875 24470 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441): Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
I20260808 20:00:20.123018 24470 leader_election.cc:304] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b91a1a84d6cd4038ac9d3ad2b8cf7979; no voters: 16a59d796024414abf9f82a7593530a6, d2c4576401a74a60855647c956b195fd
I20260808 20:00:20.123369 24658 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260808 20:00:20.348614 24657 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:00:20.348832 24657 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:20.349574 24657 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:00:20.350600 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:00:20.350800 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:00:20.350901 22604 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:00:20.351147 24657 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:00:20.791307 24678 raft_consensus.cc:493] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d2c4576401a74a60855647c956b195fd)
I20260808 20:00:20.791548 24678 raft_consensus.cc:515] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:20.792335 24678 leader_election.cc:290] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441)
W20260808 20:00:20.794620 24470 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441): Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
W20260808 20:00:20.794821 24472 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
I20260808 20:00:20.794942 24472 leader_election.cc:304] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b91a1a84d6cd4038ac9d3ad2b8cf7979; no voters: 16a59d796024414abf9f82a7593530a6, d2c4576401a74a60855647c956b195fd
I20260808 20:00:20.795210 24678 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260808 20:00:21.170661 24657 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:00:21.170913 24657 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:21.171640 24657 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:00:21.173594 22607 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
W20260808 20:00:21.173918 22604 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:00:21.174049 22604 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:00:21.174348 24657 raft_consensus.cc:2749] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:00:21.745553 24703 raft_consensus.cc:493] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d2c4576401a74a60855647c956b195fd)
I20260808 20:00:21.745812 24703 raft_consensus.cc:515] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:21.746583 24703 leader_election.cc:290] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441)
W20260808 20:00:21.763782 24470 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441): Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
W20260808 20:00:21.764075 24472 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
I20260808 20:00:21.764200 24472 leader_election.cc:304] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b91a1a84d6cd4038ac9d3ad2b8cf7979; no voters: 16a59d796024414abf9f82a7593530a6, d2c4576401a74a60855647c956b195fd
I20260808 20:00:21.764542 24703 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260808 20:00:22.011861 21649 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu
/tmp/dist-test-taskNcG5N9/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.36.126:43945
--webserver_interface=127.21.36.126
--webserver_port=37243
--builtin_ntp_servers=127.21.36.84:34883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593
--hive_metastore_uris=thrift://127.0.0.1:44789
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260808 20:00:22.387490 24716 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 20:00:22.387880 24716 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 20:00:22.387990 24716 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260808 20:00:22.397670 24716 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 20:00:22.397799 24716 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260808 20:00:22.397894 24716 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 20:00:22.397959 24716 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260808 20:00:22.409510 24716 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.36.84:34883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:44789
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.36.126:43945
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.36.126
--webserver_port=37243
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 08 Aug 2026 19:43:23 UTC on bdcb31816ec0
build id 13246
ASAN enabled
I20260808 20:00:22.411295 24716 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 20:00:22.413784 24716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 20:00:22.422406 24736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 20:00:22.422818 24740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 20:00:22.422433 24737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 20:00:22.423687 24716 server_base.cc:1061] running on GCE node
I20260808 20:00:22.424549 24716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 20:00:22.426095 24716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 20:00:22.427356 24716 hybrid_clock.cc:648] HybridClock initialized: now 1786219222427292 us; error 52 us; skew 500 ppm
I20260808 20:00:22.427781 24716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 20:00:22.430200 24716 webserver.cc:533] Webserver started at http://127.21.36.126:37243/ using document root <none> and password file <none>
I20260808 20:00:22.431080 24716 fs_manager.cc:362] Metadata directory not provided
I20260808 20:00:22.431226 24716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 20:00:22.437547 24716 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.000s sys 0.005s
I20260808 20:00:22.440896 24748 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 20:00:22.442420 24716 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 20:00:22.442655 24716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data,/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/wal
uuid: "d2c4576401a74a60855647c956b195fd"
format_stamp: "Formatted at 2026-08-08 20:00:04 on dist-test-slave-pww0"
I20260808 20:00:22.443605 24716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 20:00:22.471333 24716 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 20:00:22.472385 24716 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 20:00:22.472710 24716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 20:00:22.494228 24716 rpc_server.cc:307] RPC server started. Bound to: 127.21.36.126:43945
I20260808 20:00:22.494261 24827 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.36.126:43945 every 8 connection(s)
I20260808 20:00:22.496142 24716 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data/info.pb
I20260808 20:00:22.499305 21649 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu as pid 24716
I20260808 20:00:22.505228 24828 sys_catalog.cc:263] Verifying existing consensus state
I20260808 20:00:22.509053 24828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Bootstrap starting.
I20260808 20:00:22.527998 24828 log.cc:826] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Log is configured to *not* fsync() on all Append() calls
I20260808 20:00:22.608366 24828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Bootstrap replayed 1/1 log segments. Stats: ops{read=100 overwritten=0 applied=100 ignored=0} inserts{seen=66 ignored=0} mutations{seen=74 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 20:00:22.609006 24828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Bootstrap complete.
I20260808 20:00:22.614768 24828 raft_consensus.cc:359] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 6 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:22.615572 24828 raft_consensus.cc:740] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2c4576401a74a60855647c956b195fd, State: Initialized, Role: FOLLOWER
I20260808 20:00:22.616312 24828 consensus_queue.cc:260] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 100, Last appended: 6.100, Last appended by leader: 100, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:22.617584 24836 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:22.617954 24836 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:22.618804 24828 sys_catalog.cc:565] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 20:00:22.635973 24863 catalog_manager.cc:1295] Loaded cluster ID: 9c4ad126d38943188e9e4422f5e27418
I20260808 20:00:22.636209 24863 catalog_manager.cc:1588] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: loading cluster ID for follower catalog manager: success
I20260808 20:00:22.641357 24863 catalog_manager.cc:1610] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: acquiring CA information for follower catalog manager: success
I20260808 20:00:22.645202 24863 catalog_manager.cc:1638] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 20:00:22.643937 24716 master_runner.cc:187] Error getting master registration for 127.21.36.125:36441: Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111),
I20260808 20:00:22.649786 24716 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:00:22.855050 22794 heartbeater.cc:344] Connected to a master server at 127.21.36.126:43945
I20260808 20:00:22.858956 24774 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" instance_seqno: 1786219207065397) as {username='slave'} at 127.21.36.65:48255; Asking this server to re-register.
I20260808 20:00:22.859993 22794 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:22.862325 24774 ts_manager.cc:194] Registered new tserver with Master: 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923)
I20260808 20:00:22.883541 23256 heartbeater.cc:344] Connected to a master server at 127.21.36.126:43945
I20260808 20:00:22.885547 24774 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" instance_seqno: 1786219208132788) as {username='slave'} at 127.21.36.67:38995; Asking this server to re-register.
I20260808 20:00:22.886791 23256 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:22.888772 24774 ts_manager.cc:194] Registered new tserver with Master: 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:22.894963 23017 heartbeater.cc:344] Connected to a master server at 127.21.36.126:43945
I20260808 20:00:22.896972 24774 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" instance_seqno: 1786219207598982) as {username='slave'} at 127.21.36.66:42835; Asking this server to re-register.
I20260808 20:00:22.897631 23017 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:22.899289 24774 ts_manager.cc:194] Registered new tserver with Master: e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:22.994666 24836 raft_consensus.cc:493] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:22.995044 24836 raft_consensus.cc:515] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:22.997781 24836 leader_election.cc:290] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:00:22.998833 24749 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
W20260808 20:00:23.000910 24749 leader_election.cc:336] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441): Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
I20260808 20:00:23.005858 24511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d2c4576401a74a60855647c956b195fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 100 } } ignore_live_leader: false dest_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" is_pre_election: true
I20260808 20:00:23.006124 24511 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2c4576401a74a60855647c956b195fd in term 6.
I20260808 20:00:23.006775 24750 leader_election.cc:304] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd; no voters: 16a59d796024414abf9f82a7593530a6
I20260808 20:00:23.007272 24836 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260808 20:00:23.007428 24836 raft_consensus.cc:493] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:23.007575 24836 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 6 FOLLOWER]: Advancing to term 7
I20260808 20:00:23.012533 24836 raft_consensus.cc:515] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:23.014137 24511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d2c4576401a74a60855647c956b195fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 100 } } ignore_live_leader: false dest_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979"
I20260808 20:00:23.014369 24511 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 6 FOLLOWER]: Advancing to term 7
I20260808 20:00:23.014550 24836 leader_election.cc:290] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 7 election: Requested vote from peers 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:00:23.015547 24749 leader_election.cc:336] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441): Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
I20260808 20:00:23.017416 24511 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2c4576401a74a60855647c956b195fd in term 7.
I20260808 20:00:23.017977 24750 leader_election.cc:304] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd; no voters: 16a59d796024414abf9f82a7593530a6
I20260808 20:00:23.018301 24836 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 7 FOLLOWER]: Leader election won for term 7
I20260808 20:00:23.018767 24836 raft_consensus.cc:697] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 7 LEADER]: Becoming Leader. State: Replica: d2c4576401a74a60855647c956b195fd, State: Running, Role: LEADER
I20260808 20:00:23.019413 24836 consensus_queue.cc:237] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 100, Committed index: 100, Last appended: 6.100, Last appended by leader: 100, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:23.022500 24885 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2c4576401a74a60855647c956b195fd. Latest consensus state: current_term: 7 leader_uuid: "d2c4576401a74a60855647c956b195fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:23.022907 24885 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: This master's current role is: LEADER
I20260808 20:00:23.023815 24888 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 20:00:23.026739 24888 catalog_manager.cc:679] Loaded metadata for table default.table_f7a6e8903ed74dc088eb1f490788c54b [id=0145ea517a7a4aec99304181d1c6cb28]
I20260808 20:00:23.027215 24888 catalog_manager.cc:679] Loaded metadata for table default.table_324c660111c84a72a6935eb8e30a7ae6 [id=06447c1e53ac4366baae14ef41588d7f]
I20260808 20:00:23.027639 24888 catalog_manager.cc:679] Loaded metadata for table default.table_61bf42c8286347d197162895f70520d7 [id=08230c16ec604c259195bbfa0c062164]
I20260808 20:00:23.028021 24888 catalog_manager.cc:679] Loaded metadata for table default.table_3ffa098d41af4ebb987cec463feb8e76 [id=1042ec7801c740c09255102bf01b8fd2]
I20260808 20:00:23.028374 24888 catalog_manager.cc:679] Loaded metadata for table default.table_4dc166b247ee4cf89cdd926e07b51a51 [id=355ea74a32ec4502b6679611e8c8b67e]
I20260808 20:00:23.028894 24888 catalog_manager.cc:679] Loaded metadata for table default.table_752d0310c94b42d3902fffa1070bb1d4 [id=3b10ed2d37fe46a5b63d646901474c8e]
I20260808 20:00:23.029229 24888 catalog_manager.cc:679] Loaded metadata for table default.table_4ed5029dcfbd499db24fb72e6b389d42 [id=43498092c52a457d93f97ba0993e6012]
I20260808 20:00:23.029623 24888 catalog_manager.cc:679] Loaded metadata for table default.table_732a1b16caff489aa844bba46e6ec1cb [id=524bfe483c7f4c4d99d2757ff290c5eb]
I20260808 20:00:23.030014 24888 catalog_manager.cc:679] Loaded metadata for table default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528]
I20260808 20:00:23.030539 24888 catalog_manager.cc:679] Loaded metadata for table default.table_42e6672ee7be4c4389fcc998d6eb322d [id=67d34c9d2f51445e8cf367f41abbcc28]
I20260808 20:00:23.030898 24888 catalog_manager.cc:679] Loaded metadata for table default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619]
I20260808 20:00:23.031307 24888 catalog_manager.cc:679] Loaded metadata for table default.table_1cd24efa52a547cc872dd7ffe4938fb8 [id=87fca666b411494c8486baf1bfa58327]
I20260808 20:00:23.031713 24888 catalog_manager.cc:679] Loaded metadata for table default.table_5a92fa3792a1443f94a707060264359c [id=89520ebff12347f18df06b25577ecf63]
I20260808 20:00:23.032078 24888 catalog_manager.cc:679] Loaded metadata for table default.table_530ab728450b4272b3e9573534afe4e6 [id=8c917809771f4262811b9f200ff0e925]
I20260808 20:00:23.032447 24888 catalog_manager.cc:679] Loaded metadata for table default.table_583f1fdac11148488799008b032f7ef2 [id=99b11a3c5ca3411b8c1800c70f61597a]
I20260808 20:00:23.032802 24888 catalog_manager.cc:679] Loaded metadata for table default.table_831d17f2742e4fb8bc727d56fc9d1c85 [id=b47087e2cd6349b1ba2b8daf55b2d1d5]
I20260808 20:00:23.033124 24888 catalog_manager.cc:679] Loaded metadata for table default.table_ba9e157aaf3a487eb4f3f2ec9c37b761 [id=edaf172891fe4dafbc1b00bbb27d9c1c]
I20260808 20:00:23.033479 24888 catalog_manager.cc:679] Loaded metadata for table default.table_01314a1f924d4e33bdecf8797a6e2e0a [id=fb4aaf09a463481d9f5512884b9574d7]
I20260808 20:00:23.035771 24888 tablet_loader.cc:96] loaded metadata for tablet 052275c6e1d34d9d9242718b4e803b48 (table default.table_f7a6e8903ed74dc088eb1f490788c54b [id=0145ea517a7a4aec99304181d1c6cb28])
I20260808 20:00:23.036648 24888 tablet_loader.cc:96] loaded metadata for tablet 1f1032c7852540c9bda3a1c37cd4bc9f (table default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619])
I20260808 20:00:23.037024 24888 tablet_loader.cc:96] loaded metadata for tablet 2086c55bb74a4997bcc9a49205ecf0f5 (table default.table_01314a1f924d4e33bdecf8797a6e2e0a [id=fb4aaf09a463481d9f5512884b9574d7])
I20260808 20:00:23.037366 24888 tablet_loader.cc:96] loaded metadata for tablet 2523719318f84e31862e40d76f9a23f5 (table default.table_5a92fa3792a1443f94a707060264359c [id=89520ebff12347f18df06b25577ecf63])
I20260808 20:00:23.037628 24888 tablet_loader.cc:96] loaded metadata for tablet 27b71167912a4250a58941600e22488e (table default.table_583f1fdac11148488799008b032f7ef2 [id=99b11a3c5ca3411b8c1800c70f61597a])
I20260808 20:00:23.037933 24888 tablet_loader.cc:96] loaded metadata for tablet 286e98ffe9b44ada92fd8e9776578df2 (table default.table_732a1b16caff489aa844bba46e6ec1cb [id=524bfe483c7f4c4d99d2757ff290c5eb])
I20260808 20:00:23.038451 24888 tablet_loader.cc:96] loaded metadata for tablet 308609a3a4504bb5902009fd82d0775b (table default.table_1cd24efa52a547cc872dd7ffe4938fb8 [id=87fca666b411494c8486baf1bfa58327])
I20260808 20:00:23.039244 24888 tablet_loader.cc:96] loaded metadata for tablet 55cf64ca16df4afbae5f58843f613f27 (table default.table_530ab728450b4272b3e9573534afe4e6 [id=8c917809771f4262811b9f200ff0e925])
I20260808 20:00:23.039582 24888 tablet_loader.cc:96] loaded metadata for tablet 55e7c93eae77489e9594c52cf22d4e45 (table default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528])
I20260808 20:00:23.039911 24888 tablet_loader.cc:96] loaded metadata for tablet 57c91cdb20e74754b418cbc9af674632 (table default.table_42e6672ee7be4c4389fcc998d6eb322d [id=67d34c9d2f51445e8cf367f41abbcc28])
I20260808 20:00:23.040230 24888 tablet_loader.cc:96] loaded metadata for tablet 5d0d61aef7854aa49fe36f2f505207b7 (table default.table_4dc166b247ee4cf89cdd926e07b51a51 [id=355ea74a32ec4502b6679611e8c8b67e])
I20260808 20:00:23.041544 24888 tablet_loader.cc:96] loaded metadata for tablet 9b63e4c056f34242aacef5ffafb14b25 (table default.table_ba9e157aaf3a487eb4f3f2ec9c37b761 [id=edaf172891fe4dafbc1b00bbb27d9c1c])
I20260808 20:00:23.041813 24888 tablet_loader.cc:96] loaded metadata for tablet a065666fbe014e339992f3d0e4cb18d2 (table default.table_61bf42c8286347d197162895f70520d7 [id=08230c16ec604c259195bbfa0c062164])
I20260808 20:00:23.042421 24888 tablet_loader.cc:96] loaded metadata for tablet b45729e2ec9e4a77b8be89f9657b0424 (table default.table_4ed5029dcfbd499db24fb72e6b389d42 [id=43498092c52a457d93f97ba0993e6012])
I20260808 20:00:23.042749 24888 tablet_loader.cc:96] loaded metadata for tablet b8948ef8ed844727b9fed1e91d9233f6 (table default.table_324c660111c84a72a6935eb8e30a7ae6 [id=06447c1e53ac4366baae14ef41588d7f])
I20260808 20:00:23.043102 24888 tablet_loader.cc:96] loaded metadata for tablet c75913753d95447783b9b7c7bb6ee701 (table default.table_752d0310c94b42d3902fffa1070bb1d4 [id=3b10ed2d37fe46a5b63d646901474c8e])
I20260808 20:00:23.044061 24888 tablet_loader.cc:96] loaded metadata for tablet e18581438df6444e98c94b958a31650c (table default.table_3ffa098d41af4ebb987cec463feb8e76 [id=1042ec7801c740c09255102bf01b8fd2])
I20260808 20:00:23.044359 24888 tablet_loader.cc:96] loaded metadata for tablet fabdfe3ddfa74b98a7cc870c4c8e9af6 (table default.table_831d17f2742e4fb8bc727d56fc9d1c85 [id=b47087e2cd6349b1ba2b8daf55b2d1d5])
I20260808 20:00:23.044625 24888 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 20:00:23.045925 24888 catalog_manager.cc:1295] Loaded cluster ID: 9c4ad126d38943188e9e4422f5e27418
I20260808 20:00:23.046011 24888 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 20:00:23.048148 24888 catalog_manager.cc:1540] Loading token signing keys...
I20260808 20:00:23.049508 24888 catalog_manager.cc:6103] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Loaded TSK: 0
I20260808 20:00:23.050647 24888 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 20:00:23.052009 24888 catalog_manager.cc:1563] Loading latest processed Hive Metastore notification log event ID...
I20260808 20:00:23.053256 24888 catalog_manager.cc:5941] Last processed Hive Metastore notification event ID: 20
I20260808 20:00:23.101440 24774 master_service.cc:960] ReplaceTablet: received request to replace tablet e18581438df6444e98c94b958a31650c from {username='slave'} at 127.0.0.1:57360
I20260808 20:00:23.101699 24773 master_service.cc:960] ReplaceTablet: received request to replace tablet 3c66d42b171948bba3f76c598b60e858 from {username='slave'} at 127.0.0.1:57360
I20260808 20:00:23.101738 24772 master_service.cc:960] ReplaceTablet: received request to replace tablet 78ab65d40a004ef9888b6577716b783c from {username='slave'} at 127.0.0.1:57360
I20260808 20:00:23.102123 24771 master_service.cc:960] ReplaceTablet: received request to replace tablet 3c66d42b171948bba3f76c598b60e858 from {username='slave'} at 127.0.0.1:57360
I20260808 20:00:23.102833 24767 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57360:
table { table_name: "default.Table_530ab728450b4272b3e9573534afe4e6" } new_table_name: "default.Table_924eca5df51c4cceb65228505a337698" modify_external_catalogs: true
I20260808 20:00:23.103439 24764 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57360:
table { table_name: "default.Table_4dc166b247ee4cf89cdd926e07b51a51" } modify_external_catalogs: true
I20260808 20:00:23.103816 24764 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57360:
table { table_name: "default.Table_4dc166b247ee4cf89cdd926e07b51a51" } modify_external_catalogs: true
I20260808 20:00:23.104844 24765 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57360:
table { table_name: "default.Table_3ffa098d41af4ebb987cec463feb8e76" } new_table_name: "default.Table_7e7179fca77a4eba85afe7296adac113" modify_external_catalogs: true
I20260808 20:00:23.104979 24772 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57360:
name: "default.Table_b7b099db34ef495387d5650e289948e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:23.105978 24763 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57360:
name: "default.Table_f5c38573b0784ce8816d5a8a04f841d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:23.107086 24773 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57360:
table { table_name: "default.Table_46d148afc6d142a0855d47f765b25297" } modify_external_catalogs: true
I20260808 20:00:23.107491 24773 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57360:
table { table_name: "default.Table_46d148afc6d142a0855d47f765b25297" } modify_external_catalogs: true
I20260808 20:00:23.107594 24771 master_service.cc:960] ReplaceTablet: received request to replace tablet d1c720d7dc8e4b8184ffc863a22cf9e3 from {username='slave'} at 127.0.0.1:57360
I20260808 20:00:23.108709 24766 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57360:
table { table_name: "default.Table_1cd24efa52a547cc872dd7ffe4938fb8" } new_table_name: "default.Table_eeef3b0a60b348b7b04564f853ad9db6" modify_external_catalogs: true
I20260808 20:00:23.109833 24768 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57360:
table { table_name: "default.Table_c083bd43fffa4344b41de48e5edd3fd3" } modify_external_catalogs: true
I20260808 20:00:23.110070 24768 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57360:
table { table_name: "default.Table_c083bd43fffa4344b41de48e5edd3fd3" } modify_external_catalogs: true
I20260808 20:00:23.110226 24511 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 7 FOLLOWER]: Refusing update from remote peer d2c4576401a74a60855647c956b195fd: Log matching property violated. Preceding OpId in replica: term: 6 index: 100. Preceding OpId from leader: term: 7 index: 102. (index mismatch)
I20260808 20:00:23.110288 24771 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57360:
table { table_name: "default.Table_324c660111c84a72a6935eb8e30a7ae6" } modify_external_catalogs: true
I20260808 20:00:23.110463 24771 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57360:
table { table_name: "default.Table_324c660111c84a72a6935eb8e30a7ae6" } modify_external_catalogs: true
I20260808 20:00:23.111140 24836 consensus_queue.cc:1048] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 101, Last known committed idx: 100, Time since last communication: 0.000s
W20260808 20:00:23.112825 24749 consensus_peers.cc:597] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd -> Peer 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441): Couldn't send request to peer 16a59d796024414abf9f82a7593530a6. Status: Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 20:00:23.115684 24893 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2c4576401a74a60855647c956b195fd. Latest consensus state: current_term: 7 leader_uuid: "d2c4576401a74a60855647c956b195fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:23.116060 24893 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: This master's current role is: FOLLOWER
F20260808 20:00:23.116143 24860 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 27, previous 27; dumping first 8 out of 15 received events: NotificationEvent(eventId=21, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_831d17f2742e4fb8bc727d56fc9d1c85, message={"server":"","servicePrincipal":"","db":"default","table":"table_831d17f2742e4fb8bc727d56fc9d1c85","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_831d17f2742e4fb8bc727d56fc9d1c85\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219209},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_831d17f2742e4fb8bc727d56fc9d1c85\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_831d17f2742e4fb8bc727d56fc9d1c85\",\"kudu.table_id\":\"b47087e2cd6349b1ba2b8daf55b2d1d5\",\"transient_lastDdlTime\":\"1786219209\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=22, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_752d0310c94b42d3902fffa1070bb1d4, message={"server":"","servicePrincipal":"","db":"default","table":"table_752d0310c94b42d3902fffa1070bb1d4","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_752d0310c94b42d3902fffa1070bb1d4\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219209},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_752d0310c94b42d3902fffa1070bb1d4\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_752d0310c94b42d3902fffa1070bb1d4\",\"kudu.table_id\":\"3b10ed2d37fe46a5b63d646901474c8e\",\"transient_lastDdlTime\":\"1786219209\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1786219212, eventType=CREATE_TABLE, dbName=default, tableName=table_aa0809b208774982934a9f8de43aecf5, message={"server":"","servicePrincipal":"","db":"default","table":"table_aa0809b208774982934a9f8de43aecf5","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_aa0809b208774982934a9f8de43aecf5\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219212},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_aa0809b208774982934a9f8de43aecf5\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_aa0809b208774982934a9f8de43aecf5\",\"kudu.table_id\":\"1ba38449531f437d8795f5e35a3f9479\",\"transient_lastDdlTime\":\"1786219212\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=24, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_4dc166b247ee4cf89cdd926e07b51a51, message={"server":"","servicePrincipal":"","db":"default","table":"table_4dc166b247ee4cf89cdd926e07b51a51","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_4dc166b247ee4cf89cdd926e07b51a51\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219210},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_4dc166b247ee4cf89cdd926e07b51a51\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_4dc166b247ee4cf89cdd926e07b51a51\",\"kudu.table_id\":\"355ea74a32ec4502b6679611e8c8b67e\",\"transient_lastDdlTime\":\"1786219210\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=25, eventTime=1786219212, eventType=CREATE_TABLE, dbName=default, tableName=table_bfc21652528345b883ecf7962d128fee, message={"server":"","servicePrincipal":"","db":"default","table":"table_bfc21652528345b883ecf7962d128fee","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_bfc21652528345b883ecf7962d128fee\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219212},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_bfc21652528345b883ecf7962d128fee\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_bfc21652528345b883ecf7962d128fee\",\"kudu.table_id\":\"95d1dc4138bd491da51e09440dab7eee\",\"transient_lastDdlTime\":\"1786219212\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=26, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_324c660111c84a72a6935eb8e30a7ae6, message={"server":"","servicePrincipal":"","db":"default","table":"table_324c660111c84a72a6935eb8e30a7ae6","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_324c660111c84a72a6935eb8e30a7ae6\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219209},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_324c660111c84a72a6935eb8e30a7ae6\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_324c660111c84a72a6935eb8e30a7ae6\",\"kudu.table_id\":\"06447c1e53ac4366baae14ef41588d7f\",\"transient_lastDdlTime\":\"1786219209\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=27, eventTime=1786219212, eventType=CREATE_TABLE, dbName=default, tableName=table_42e6672ee7be4c4389fcc998d6eb322d, message={"server":"","servicePrincipal":"","db":"default","table":"table_42e6672ee7be4c4389fcc998d6eb322d","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_42e6672ee7be4c4389fcc998d6eb322d\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219212},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_42e6672ee7be4c4389fcc998d6eb322d\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_42e6672ee7be4c4389fcc998d6eb322d\",\"kudu.table_id\":\"67d34c9d2f51445e8cf367f41abbcc28\",\"transient_lastDdlTime\":\"1786219212\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=27, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_5730907850e643b4ac068a85e1574ddf, message={"server":"","servicePrincipal":"","db":"default","table":"table_5730907850e643b4ac068a85e1574ddf","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_5730907850e643b4ac068a85e1574ddf\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219212},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_5730907850e643b4ac068a85e1574ddf\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_5730907850e643b4ac068a85e1574ddf\",\"kudu.table_id\":\"bce1917a27c14330bfe2ccc5dc0b40a3\",\"transient_lastDdlTime\":\"1786219212\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
I20260808 20:00:23.118515 24885 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 7 leader_uuid: "d2c4576401a74a60855647c956b195fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:23.118773 24885 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: This master's current role is: LEADER
@ 0x7f05b4520d5d google::LogMessage::Fail() at ??:0
I20260808 20:00:23.119742 24893 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "d2c4576401a74a60855647c956b195fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:23.119951 24893 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:23.120761 24774 catalog_manager.cc:6006] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Sending DeleteTablet for 3 replicas of tablet e18581438df6444e98c94b958a31650c
@ 0x7f05b4524b23 google::LogMessage::SendToLog() at ??:0
@ 0x7f05b452075c google::LogMessage::Flush() at ??:0
@ 0x7f05b45209a1 google::LogMessage::~LogMessage() at ??:0
I20260808 20:00:23.128623 24774 catalog_manager.cc:6807] ReplaceTablet: tablet e18581438df6444e98c94b958a31650c deleted and replaced by tablet 5588a78091484cc2a3636e4e0f6d1c30
I20260808 20:00:23.129735 24774 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57360:
table { table_name: "default.Table_4ed5029dcfbd499db24fb72e6b389d42" } new_table_name: "default.Table_a9d94ade99394dc6b742a534c91da3bd" modify_external_catalogs: true
@ 0x7f05cb1e9f64 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f05cb1e8811 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260808 20:00:23.157229 22903 tablet_service.cc:1511] Processing CreateTablet for tablet 5588a78091484cc2a3636e4e0f6d1c30 (DEFAULT_TABLE table=default.table_3ffa098d41af4ebb987cec463feb8e76 [id=1042ec7801c740c09255102bf01b8fd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:23.157505 22899 tablet_service.cc:1511] Processing CreateTablet for tablet 27b71167912a4250a58941600e22488e (DEFAULT_TABLE table=default.table_583f1fdac11148488799008b032f7ef2 [id=99b11a3c5ca3411b8c1800c70f61597a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:23.157721 22901 tablet_service.cc:1558] Processing DeleteTablet for tablet e18581438df6444e98c94b958a31650c with delete_type TABLET_DATA_DELETED (replaced by tablet 5588a78091484cc2a3636e4e0f6d1c30) from {username='slave'} at 127.0.0.1:55302
I20260808 20:00:23.157891 22903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5588a78091484cc2a3636e4e0f6d1c30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:23.158325 22898 tablet_service.cc:1511] Processing CreateTablet for tablet 052275c6e1d34d9d9242718b4e803b48 (DEFAULT_TABLE table=default.table_f7a6e8903ed74dc088eb1f490788c54b [id=0145ea517a7a4aec99304181d1c6cb28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:23.158396 22906 tablet_service.cc:1511] Processing CreateTablet for tablet 55e7c93eae77489e9594c52cf22d4e45 (DEFAULT_TABLE table=default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:23.158831 22898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 052275c6e1d34d9d9242718b4e803b48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:23.159155 22908 tablet_service.cc:1511] Processing CreateTablet for tablet a065666fbe014e339992f3d0e4cb18d2 (DEFAULT_TABLE table=default.table_61bf42c8286347d197162895f70520d7 [id=08230c16ec604c259195bbfa0c062164]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:23.161314 22908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a065666fbe014e339992f3d0e4cb18d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:23.161580 22897 tablet_service.cc:1511] Processing CreateTablet for tablet fabdfe3ddfa74b98a7cc870c4c8e9af6 (DEFAULT_TABLE table=default.table_831d17f2742e4fb8bc727d56fc9d1c85 [id=b47087e2cd6349b1ba2b8daf55b2d1d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:23.161854 23143 tablet_service.cc:1558] Processing DeleteTablet for tablet e18581438df6444e98c94b958a31650c with delete_type TABLET_DATA_DELETED (replaced by tablet 5588a78091484cc2a3636e4e0f6d1c30) from {username='slave'} at 127.0.0.1:35976
I20260808 20:00:23.162478 23136 tablet_service.cc:1511] Processing CreateTablet for tablet 55e7c93eae77489e9594c52cf22d4e45 (DEFAULT_TABLE table=default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:23.162932 23136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e7c93eae77489e9594c52cf22d4e45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:23.162974 23141 tablet_service.cc:1511] Processing CreateTablet for tablet fabdfe3ddfa74b98a7cc870c4c8e9af6 (DEFAULT_TABLE table=default.table_831d17f2742e4fb8bc727d56fc9d1c85 [id=b47087e2cd6349b1ba2b8daf55b2d1d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:23.163376 23141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fabdfe3ddfa74b98a7cc870c4c8e9af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:23.165661 22899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27b71167912a4250a58941600e22488e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:23.166735 22905 tablet_service.cc:1511] Processing CreateTablet for tablet 308609a3a4504bb5902009fd82d0775b (DEFAULT_TABLE table=default.table_1cd24efa52a547cc872dd7ffe4938fb8 [id=87fca666b411494c8486baf1bfa58327]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:23.167900 23140 tablet_service.cc:1511] Processing CreateTablet for tablet 052275c6e1d34d9d9242718b4e803b48 (DEFAULT_TABLE table=default.table_f7a6e8903ed74dc088eb1f490788c54b [id=0145ea517a7a4aec99304181d1c6cb28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:23.168480 23140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 052275c6e1d34d9d9242718b4e803b48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:23.168985 22897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fabdfe3ddfa74b98a7cc870c4c8e9af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:23.169492 22905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 308609a3a4504bb5902009fd82d0775b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:23.170751 23144 tablet_service.cc:1511] Processing CreateTablet for tablet a065666fbe014e339992f3d0e4cb18d2 (DEFAULT_TABLE table=default.table_61bf42c8286347d197162895f70520d7 [id=08230c16ec604c259195bbfa0c062164]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:23.171352 23135 tablet_service.cc:1511] Processing CreateTablet for tablet 308609a3a4504bb5902009fd82d0775b (DEFAULT_TABLE table=default.table_1cd24efa52a547cc872dd7ffe4938fb8 [id=87fca666b411494c8486baf1bfa58327]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:23.173264 22906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e7c93eae77489e9594c52cf22d4e45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:23.174419 23144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a065666fbe014e339992f3d0e4cb18d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:23.175254 23135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 308609a3a4504bb5902009fd82d0775b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:23.178699 23146 tablet_service.cc:1511] Processing CreateTablet for tablet 27b71167912a4250a58941600e22488e (DEFAULT_TABLE table=default.table_583f1fdac11148488799008b032f7ef2 [id=99b11a3c5ca3411b8c1800c70f61597a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:23.179224 23146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27b71167912a4250a58941600e22488e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:23.180173 23138 tablet_service.cc:1511] Processing CreateTablet for tablet 5588a78091484cc2a3636e4e0f6d1c30 (DEFAULT_TABLE table=default.table_3ffa098d41af4ebb987cec463feb8e76 [id=1042ec7801c740c09255102bf01b8fd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:23.180640 23138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5588a78091484cc2a3636e4e0f6d1c30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:23.180868 22674 tablet_service.cc:1558] Processing DeleteTablet for tablet e18581438df6444e98c94b958a31650c with delete_type TABLET_DATA_DELETED (replaced by tablet 5588a78091484cc2a3636e4e0f6d1c30) from {username='slave'} at 127.0.0.1:53320
I20260808 20:00:23.181263 22678 tablet_service.cc:1511] Processing CreateTablet for tablet a065666fbe014e339992f3d0e4cb18d2 (DEFAULT_TABLE table=default.table_61bf42c8286347d197162895f70520d7 [id=08230c16ec604c259195bbfa0c062164]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:23.181707 22678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a065666fbe014e339992f3d0e4cb18d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:23.181804 22676 tablet_service.cc:1511] Processing CreateTablet for tablet 55e7c93eae77489e9594c52cf22d4e45 (DEFAULT_TABLE table=default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:23.181998 22671 tablet_service.cc:1511] Processing CreateTablet for tablet 5588a78091484cc2a3636e4e0f6d1c30 (DEFAULT_TABLE table=default.table_3ffa098d41af4ebb987cec463feb8e76 [id=1042ec7801c740c09255102bf01b8fd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:23.182247 22676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e7c93eae77489e9594c52cf22d4e45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:23.182518 22671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5588a78091484cc2a3636e4e0f6d1c30. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f05cb1f048c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260808 20:00:23.184350 22673 tablet_service.cc:1511] Processing CreateTablet for tablet 308609a3a4504bb5902009fd82d0775b (DEFAULT_TABLE table=default.table_1cd24efa52a547cc872dd7ffe4938fb8 [id=87fca666b411494c8486baf1bfa58327]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:23.185029 22668 tablet_service.cc:1511] Processing CreateTablet for tablet 27b71167912a4250a58941600e22488e (DEFAULT_TABLE table=default.table_583f1fdac11148488799008b032f7ef2 [id=99b11a3c5ca3411b8c1800c70f61597a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:23.185789 22665 tablet_service.cc:1511] Processing CreateTablet for tablet 052275c6e1d34d9d9242718b4e803b48 (DEFAULT_TABLE table=default.table_f7a6e8903ed74dc088eb1f490788c54b [id=0145ea517a7a4aec99304181d1c6cb28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:23.190274 22664 tablet_service.cc:1511] Processing CreateTablet for tablet fabdfe3ddfa74b98a7cc870c4c8e9af6 (DEFAULT_TABLE table=default.table_831d17f2742e4fb8bc727d56fc9d1c85 [id=b47087e2cd6349b1ba2b8daf55b2d1d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 20:00:23.190559 22673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 308609a3a4504bb5902009fd82d0775b. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f05cb1f0309 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaaf86d std::function<>::operator()() at ??:?
I20260808 20:00:23.197098 22668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27b71167912a4250a58941600e22488e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:23.198043 22665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 052275c6e1d34d9d9242718b4e803b48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:23.198827 22664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fabdfe3ddfa74b98a7cc870c4c8e9af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 20:00:23.198953 24913 tablet_replica.cc:333] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9: stopping tablet replica
I20260808 20:00:23.200232 24913 raft_consensus.cc:2243] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 LEADER]: Raft consensus shutting down.
I20260808 20:00:23.200728 24913 raft_consensus.cc:2272] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:23.201360 24913 ts_tablet_manager.cc:1916] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7f05b7248dd9 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f05ba9186db start_thread at ??:0
@ 0x7f05b33cf61f clone at ??:0
I20260808 20:00:23.217749 24912 tablet_replica.cc:333] T e18581438df6444e98c94b958a31650c P e34d5caee97d44fa945a91ddc6a54653: stopping tablet replica
I20260808 20:00:23.217772 24916 tablet_replica.cc:333] T e18581438df6444e98c94b958a31650c P 257c9c7e0c6c441593eac06beb31fa4e: stopping tablet replica
I20260808 20:00:23.217998 24912 raft_consensus.cc:2243] T e18581438df6444e98c94b958a31650c P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:23.218041 24916 raft_consensus.cc:2243] T e18581438df6444e98c94b958a31650c P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:23.218240 24912 raft_consensus.cc:2272] T e18581438df6444e98c94b958a31650c P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:23.218328 24916 raft_consensus.cc:2272] T e18581438df6444e98c94b958a31650c P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:23.218842 24912 ts_tablet_manager.cc:1916] T e18581438df6444e98c94b958a31650c P e34d5caee97d44fa945a91ddc6a54653: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:23.218967 24916 ts_tablet_manager.cc:1916] T e18581438df6444e98c94b958a31650c P 257c9c7e0c6c441593eac06beb31fa4e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:23.233528 24912 ts_tablet_manager.cc:1929] T e18581438df6444e98c94b958a31650c P e34d5caee97d44fa945a91ddc6a54653: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260808 20:00:23.233700 24912 log.cc:1199] T e18581438df6444e98c94b958a31650c P e34d5caee97d44fa945a91ddc6a54653: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/wal/wals/e18581438df6444e98c94b958a31650c
I20260808 20:00:23.234163 24912 ts_tablet_manager.cc:1950] T e18581438df6444e98c94b958a31650c P e34d5caee97d44fa945a91ddc6a54653: Deleting consensus metadata
I20260808 20:00:23.234978 24919 tablet_bootstrap.cc:492] T 5588a78091484cc2a3636e4e0f6d1c30 P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:23.239544 24913 ts_tablet_manager.cc:1929] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260808 20:00:23.239735 24913 log.cc:1199] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/wal/wals/e18581438df6444e98c94b958a31650c
I20260808 20:00:23.240048 24919 tablet_bootstrap.cc:654] T 5588a78091484cc2a3636e4e0f6d1c30 P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:23.240921 24913 ts_tablet_manager.cc:1950] T e18581438df6444e98c94b958a31650c P 5f6b6c2e318d44a984120a06a09e9af9: Deleting consensus metadata
I20260808 20:00:23.242093 24921 tablet_bootstrap.cc:492] T a065666fbe014e339992f3d0e4cb18d2 P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:23.257018 24921 tablet_bootstrap.cc:654] T a065666fbe014e339992f3d0e4cb18d2 P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:23.259940 24916 ts_tablet_manager.cc:1929] T e18581438df6444e98c94b958a31650c P 257c9c7e0c6c441593eac06beb31fa4e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260808 20:00:23.260097 24916 log.cc:1199] T e18581438df6444e98c94b958a31650c P 257c9c7e0c6c441593eac06beb31fa4e: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-0/wal/wals/e18581438df6444e98c94b958a31650c
I20260808 20:00:23.260571 24916 ts_tablet_manager.cc:1950] T e18581438df6444e98c94b958a31650c P 257c9c7e0c6c441593eac06beb31fa4e: Deleting consensus metadata
I20260808 20:00:23.264374 24917 tablet_bootstrap.cc:492] T 55e7c93eae77489e9594c52cf22d4e45 P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:23.266471 24917 tablet_bootstrap.cc:654] T 55e7c93eae77489e9594c52cf22d4e45 P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:23.288398 24917 tablet_bootstrap.cc:492] T 55e7c93eae77489e9594c52cf22d4e45 P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:23.288584 24917 ts_tablet_manager.cc:1403] T 55e7c93eae77489e9594c52cf22d4e45 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.002s
I20260808 20:00:23.289495 24917 raft_consensus.cc:359] T 55e7c93eae77489e9594c52cf22d4e45 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:23.289714 24917 raft_consensus.cc:385] T 55e7c93eae77489e9594c52cf22d4e45 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:23.289804 24917 raft_consensus.cc:740] T 55e7c93eae77489e9594c52cf22d4e45 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:23.292119 24921 tablet_bootstrap.cc:492] T a065666fbe014e339992f3d0e4cb18d2 P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:23.292320 24921 ts_tablet_manager.cc:1403] T a065666fbe014e339992f3d0e4cb18d2 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.050s user 0.005s sys 0.022s
I20260808 20:00:23.293488 24921 raft_consensus.cc:359] T a065666fbe014e339992f3d0e4cb18d2 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.293711 24921 raft_consensus.cc:385] T a065666fbe014e339992f3d0e4cb18d2 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:23.293807 24921 raft_consensus.cc:740] T a065666fbe014e339992f3d0e4cb18d2 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:23.294138 24921 consensus_queue.cc:260] T a065666fbe014e339992f3d0e4cb18d2 P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.294337 24917 consensus_queue.cc:260] T 55e7c93eae77489e9594c52cf22d4e45 P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:23.295069 24917 ts_tablet_manager.cc:1434] T 55e7c93eae77489e9594c52cf22d4e45 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260808 20:00:23.300248 24921 ts_tablet_manager.cc:1434] T a065666fbe014e339992f3d0e4cb18d2 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260808 20:00:23.300316 24919 tablet_bootstrap.cc:492] T 5588a78091484cc2a3636e4e0f6d1c30 P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:23.300480 24919 ts_tablet_manager.cc:1403] T 5588a78091484cc2a3636e4e0f6d1c30 P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.066s user 0.011s sys 0.017s
I20260808 20:00:23.301409 24919 raft_consensus.cc:359] T 5588a78091484cc2a3636e4e0f6d1c30 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.301633 24919 raft_consensus.cc:385] T 5588a78091484cc2a3636e4e0f6d1c30 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:23.301731 24919 raft_consensus.cc:740] T 5588a78091484cc2a3636e4e0f6d1c30 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:23.301971 24919 consensus_queue.cc:260] T 5588a78091484cc2a3636e4e0f6d1c30 P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.303876 24917 tablet_bootstrap.cc:492] T 052275c6e1d34d9d9242718b4e803b48 P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:23.303897 24919 ts_tablet_manager.cc:1434] T 5588a78091484cc2a3636e4e0f6d1c30 P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 20:00:23.304207 24919 tablet_bootstrap.cc:492] T a065666fbe014e339992f3d0e4cb18d2 P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:23.306044 24917 tablet_bootstrap.cc:654] T 052275c6e1d34d9d9242718b4e803b48 P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:23.306048 24919 tablet_bootstrap.cc:654] T a065666fbe014e339992f3d0e4cb18d2 P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:23.312041 24921 tablet_bootstrap.cc:492] T 55e7c93eae77489e9594c52cf22d4e45 P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:23.313978 24921 tablet_bootstrap.cc:654] T 55e7c93eae77489e9594c52cf22d4e45 P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:23.341451 24919 tablet_bootstrap.cc:492] T a065666fbe014e339992f3d0e4cb18d2 P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:23.341709 24919 ts_tablet_manager.cc:1403] T a065666fbe014e339992f3d0e4cb18d2 P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.038s user 0.019s sys 0.000s
I20260808 20:00:23.342667 24919 raft_consensus.cc:359] T a065666fbe014e339992f3d0e4cb18d2 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.342937 24919 raft_consensus.cc:385] T a065666fbe014e339992f3d0e4cb18d2 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:23.343041 24919 raft_consensus.cc:740] T a065666fbe014e339992f3d0e4cb18d2 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:23.343382 24919 consensus_queue.cc:260] T a065666fbe014e339992f3d0e4cb18d2 P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.344178 24919 ts_tablet_manager.cc:1434] T a065666fbe014e339992f3d0e4cb18d2 P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 20:00:23.348946 24921 tablet_bootstrap.cc:492] T 55e7c93eae77489e9594c52cf22d4e45 P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:23.349175 24921 ts_tablet_manager.cc:1403] T 55e7c93eae77489e9594c52cf22d4e45 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.037s user 0.017s sys 0.017s
I20260808 20:00:23.349365 24917 tablet_bootstrap.cc:492] T 052275c6e1d34d9d9242718b4e803b48 P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:23.349560 24917 ts_tablet_manager.cc:1403] T 052275c6e1d34d9d9242718b4e803b48 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.046s user 0.013s sys 0.030s
I20260808 20:00:23.350047 24921 raft_consensus.cc:359] T 55e7c93eae77489e9594c52cf22d4e45 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:23.350371 24921 raft_consensus.cc:385] T 55e7c93eae77489e9594c52cf22d4e45 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:23.350455 24921 raft_consensus.cc:740] T 55e7c93eae77489e9594c52cf22d4e45 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:23.350380 24917 raft_consensus.cc:359] T 052275c6e1d34d9d9242718b4e803b48 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.350579 24917 raft_consensus.cc:385] T 052275c6e1d34d9d9242718b4e803b48 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:23.350672 24917 raft_consensus.cc:740] T 052275c6e1d34d9d9242718b4e803b48 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:23.350782 24921 consensus_queue.cc:260] T 55e7c93eae77489e9594c52cf22d4e45 P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:23.350956 24917 consensus_queue.cc:260] T 052275c6e1d34d9d9242718b4e803b48 P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.351512 24917 ts_tablet_manager.cc:1434] T 052275c6e1d34d9d9242718b4e803b48 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260808 20:00:23.351845 24917 tablet_bootstrap.cc:492] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:23.353714 24917 tablet_bootstrap.cc:654] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:23.355865 24921 ts_tablet_manager.cc:1434] T 55e7c93eae77489e9594c52cf22d4e45 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.007s user 0.001s sys 0.002s
I20260808 20:00:23.356287 24921 tablet_bootstrap.cc:492] T 052275c6e1d34d9d9242718b4e803b48 P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:23.356807 24919 tablet_bootstrap.cc:492] T 55e7c93eae77489e9594c52cf22d4e45 P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:23.357775 24917 tablet_bootstrap.cc:492] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:23.357999 24917 ts_tablet_manager.cc:1403] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260808 20:00:23.358261 24921 tablet_bootstrap.cc:654] T 052275c6e1d34d9d9242718b4e803b48 P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:23.358625 24919 tablet_bootstrap.cc:654] T 55e7c93eae77489e9594c52cf22d4e45 P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:23.359066 24917 raft_consensus.cc:359] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.359364 24917 raft_consensus.cc:385] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:23.359531 24917 raft_consensus.cc:740] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:23.359889 24917 consensus_queue.cc:260] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.360625 24917 ts_tablet_manager.cc:1434] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260808 20:00:23.361085 24917 tablet_bootstrap.cc:492] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:23.363260 24917 tablet_bootstrap.cc:654] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:23.372583 24917 tablet_bootstrap.cc:492] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:23.372820 24917 ts_tablet_manager.cc:1403] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.005s
I20260808 20:00:23.373713 24917 raft_consensus.cc:359] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.373958 24917 raft_consensus.cc:385] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:23.374038 24917 raft_consensus.cc:740] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:23.374444 24921 tablet_bootstrap.cc:492] T 052275c6e1d34d9d9242718b4e803b48 P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:23.374361 24917 consensus_queue.cc:260] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.374641 24921 ts_tablet_manager.cc:1403] T 052275c6e1d34d9d9242718b4e803b48 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.006s
I20260808 20:00:23.374948 24917 ts_tablet_manager.cc:1434] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260808 20:00:23.375141 24919 tablet_bootstrap.cc:492] T 55e7c93eae77489e9594c52cf22d4e45 P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:23.375334 24917 tablet_bootstrap.cc:492] T 308609a3a4504bb5902009fd82d0775b P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:23.375365 24919 ts_tablet_manager.cc:1403] T 55e7c93eae77489e9594c52cf22d4e45 P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.019s user 0.014s sys 0.004s
I20260808 20:00:23.375641 24921 raft_consensus.cc:359] T 052275c6e1d34d9d9242718b4e803b48 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.375854 24921 raft_consensus.cc:385] T 052275c6e1d34d9d9242718b4e803b48 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:23.375953 24921 raft_consensus.cc:740] T 052275c6e1d34d9d9242718b4e803b48 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:23.376219 24921 consensus_queue.cc:260] T 052275c6e1d34d9d9242718b4e803b48 P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.376806 24921 ts_tablet_manager.cc:1434] T 052275c6e1d34d9d9242718b4e803b48 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 20:00:23.377126 24921 tablet_bootstrap.cc:492] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:23.377140 24917 tablet_bootstrap.cc:654] T 308609a3a4504bb5902009fd82d0775b P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:23.378931 24921 tablet_bootstrap.cc:654] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:23.383675 24919 raft_consensus.cc:359] T 55e7c93eae77489e9594c52cf22d4e45 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:23.384043 24919 raft_consensus.cc:385] T 55e7c93eae77489e9594c52cf22d4e45 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:23.384239 24919 raft_consensus.cc:740] T 55e7c93eae77489e9594c52cf22d4e45 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:23.384634 24919 consensus_queue.cc:260] T 55e7c93eae77489e9594c52cf22d4e45 P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:23.385366 24919 ts_tablet_manager.cc:1434] T 55e7c93eae77489e9594c52cf22d4e45 P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260808 20:00:23.386205 24387 raft_consensus.cc:493] T 5588a78091484cc2a3636e4e0f6d1c30 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:23.386384 24387 raft_consensus.cc:515] T 5588a78091484cc2a3636e4e0f6d1c30 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.387043 24919 tablet_bootstrap.cc:492] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:23.387225 24387 leader_election.cc:290] T 5588a78091484cc2a3636e4e0f6d1c30 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923)
I20260808 20:00:23.388581 23176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5588a78091484cc2a3636e4e0f6d1c30" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9" is_pre_election: true
I20260808 20:00:23.388710 24917 tablet_bootstrap.cc:492] T 308609a3a4504bb5902009fd82d0775b P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
W20260808 20:00:23.389264 22835 leader_election.cc:343] T 5588a78091484cc2a3636e4e0f6d1c30 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Illegal state: must be running to vote when last-logged opid is not known
I20260808 20:00:23.389597 24917 ts_tablet_manager.cc:1403] T 308609a3a4504bb5902009fd82d0775b P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.014s user 0.010s sys 0.000s
I20260808 20:00:23.389904 22710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5588a78091484cc2a3636e4e0f6d1c30" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e" is_pre_election: true
I20260808 20:00:23.390635 24917 raft_consensus.cc:359] T 308609a3a4504bb5902009fd82d0775b P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
W20260808 20:00:23.390769 22831 leader_election.cc:343] T 5588a78091484cc2a3636e4e0f6d1c30 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Illegal state: must be running to vote when last-logged opid is not known
I20260808 20:00:23.390928 24917 raft_consensus.cc:385] T 308609a3a4504bb5902009fd82d0775b P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:23.390924 22831 leader_election.cc:304] T 5588a78091484cc2a3636e4e0f6d1c30 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e34d5caee97d44fa945a91ddc6a54653; no voters: 257c9c7e0c6c441593eac06beb31fa4e, 5f6b6c2e318d44a984120a06a09e9af9
I20260808 20:00:23.391183 24387 raft_consensus.cc:2749] T 5588a78091484cc2a3636e4e0f6d1c30 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 20:00:23.391088 24917 raft_consensus.cc:740] T 308609a3a4504bb5902009fd82d0775b P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:23.392616 24917 consensus_queue.cc:260] T 308609a3a4504bb5902009fd82d0775b P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.393229 24917 ts_tablet_manager.cc:1434] T 308609a3a4504bb5902009fd82d0775b P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260808 20:00:23.395777 24917 tablet_bootstrap.cc:492] T a065666fbe014e339992f3d0e4cb18d2 P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:23.397845 24919 tablet_bootstrap.cc:654] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:23.399756 24917 tablet_bootstrap.cc:654] T a065666fbe014e339992f3d0e4cb18d2 P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:23.400095 24921 tablet_bootstrap.cc:492] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:23.400323 24921 ts_tablet_manager.cc:1403] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.023s user 0.009s sys 0.013s
I20260808 20:00:23.401244 24921 raft_consensus.cc:359] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.401471 24921 raft_consensus.cc:385] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:23.401559 24921 raft_consensus.cc:740] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:23.401880 24921 consensus_queue.cc:260] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.402482 24921 ts_tablet_manager.cc:1434] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 20:00:23.403174 24921 tablet_bootstrap.cc:492] T 308609a3a4504bb5902009fd82d0775b P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:23.405016 24921 tablet_bootstrap.cc:654] T 308609a3a4504bb5902009fd82d0775b P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:23.409663 24917 tablet_bootstrap.cc:492] T a065666fbe014e339992f3d0e4cb18d2 P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:23.409678 24921 tablet_bootstrap.cc:492] T 308609a3a4504bb5902009fd82d0775b P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:23.409842 24921 ts_tablet_manager.cc:1403] T 308609a3a4504bb5902009fd82d0775b P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 20:00:23.409888 24917 ts_tablet_manager.cc:1403] T a065666fbe014e339992f3d0e4cb18d2 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.001s
I20260808 20:00:23.410517 24919 tablet_bootstrap.cc:492] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:23.410772 24919 ts_tablet_manager.cc:1403] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s
I20260808 20:00:23.410672 24917 raft_consensus.cc:359] T a065666fbe014e339992f3d0e4cb18d2 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.410691 24921 raft_consensus.cc:359] T 308609a3a4504bb5902009fd82d0775b P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.410872 24921 raft_consensus.cc:385] T 308609a3a4504bb5902009fd82d0775b P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:23.410887 24917 raft_consensus.cc:385] T a065666fbe014e339992f3d0e4cb18d2 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:23.410954 24917 raft_consensus.cc:740] T a065666fbe014e339992f3d0e4cb18d2 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:23.410971 24921 raft_consensus.cc:740] T 308609a3a4504bb5902009fd82d0775b P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:23.411196 24921 consensus_queue.cc:260] T 308609a3a4504bb5902009fd82d0775b P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.411268 24917 consensus_queue.cc:260] T a065666fbe014e339992f3d0e4cb18d2 P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.411916 24917 ts_tablet_manager.cc:1434] T a065666fbe014e339992f3d0e4cb18d2 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 20:00:23.412415 24921 ts_tablet_manager.cc:1434] T 308609a3a4504bb5902009fd82d0775b P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 20:00:23.412745 24921 tablet_bootstrap.cc:492] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:23.414534 24921 tablet_bootstrap.cc:654] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:23.415956 24917 tablet_bootstrap.cc:492] T 5588a78091484cc2a3636e4e0f6d1c30 P 5f6b6c2e318d44a984120a06a09e9af9: Bootstrap starting.
I20260808 20:00:23.416884 24919 raft_consensus.cc:359] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.417853 24917 tablet_bootstrap.cc:654] T 5588a78091484cc2a3636e4e0f6d1c30 P 5f6b6c2e318d44a984120a06a09e9af9: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:23.417999 24919 raft_consensus.cc:385] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:23.418174 24919 raft_consensus.cc:740] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:23.418560 24919 consensus_queue.cc:260] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.420581 24919 ts_tablet_manager.cc:1434] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260808 20:00:23.425983 24919 tablet_bootstrap.cc:492] T 27b71167912a4250a58941600e22488e P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:23.428822 24919 tablet_bootstrap.cc:654] T 27b71167912a4250a58941600e22488e P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:23.431130 24921 tablet_bootstrap.cc:492] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:23.431357 24921 ts_tablet_manager.cc:1403] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.019s user 0.011s sys 0.003s
I20260808 20:00:23.431449 24917 tablet_bootstrap.cc:492] T 5588a78091484cc2a3636e4e0f6d1c30 P 5f6b6c2e318d44a984120a06a09e9af9: No bootstrap required, opened a new log
I20260808 20:00:23.431633 24917 ts_tablet_manager.cc:1403] T 5588a78091484cc2a3636e4e0f6d1c30 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.013s
I20260808 20:00:23.431879 24387 raft_consensus.cc:493] T a065666fbe014e339992f3d0e4cb18d2 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:23.432030 24387 raft_consensus.cc:515] T a065666fbe014e339992f3d0e4cb18d2 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.432399 24921 raft_consensus.cc:359] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.432469 24917 raft_consensus.cc:359] T 5588a78091484cc2a3636e4e0f6d1c30 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.432607 24921 raft_consensus.cc:385] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:23.432652 24917 raft_consensus.cc:385] T 5588a78091484cc2a3636e4e0f6d1c30 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:23.432683 24921 raft_consensus.cc:740] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:23.432744 24917 raft_consensus.cc:740] T 5588a78091484cc2a3636e4e0f6d1c30 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Initialized, Role: FOLLOWER
I20260808 20:00:23.432755 24387 leader_election.cc:290] T a065666fbe014e339992f3d0e4cb18d2 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923)
I20260808 20:00:23.432976 24917 consensus_queue.cc:260] T 5588a78091484cc2a3636e4e0f6d1c30 P 5f6b6c2e318d44a984120a06a09e9af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.432978 24921 consensus_queue.cc:260] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.433578 24917 ts_tablet_manager.cc:1434] T 5588a78091484cc2a3636e4e0f6d1c30 P 5f6b6c2e318d44a984120a06a09e9af9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260808 20:00:23.434343 24919 tablet_bootstrap.cc:492] T 27b71167912a4250a58941600e22488e P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:23.434500 24919 ts_tablet_manager.cc:1403] T 27b71167912a4250a58941600e22488e P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260808 20:00:23.434731 22710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a065666fbe014e339992f3d0e4cb18d2" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e" is_pre_election: true
I20260808 20:00:23.434954 22710 raft_consensus.cc:2468] T a065666fbe014e339992f3d0e4cb18d2 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 0.
I20260808 20:00:23.435261 24919 raft_consensus.cc:359] T 27b71167912a4250a58941600e22488e P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.435441 24919 raft_consensus.cc:385] T 27b71167912a4250a58941600e22488e P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:23.435562 24919 raft_consensus.cc:740] T 27b71167912a4250a58941600e22488e P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:23.435793 24919 consensus_queue.cc:260] T 27b71167912a4250a58941600e22488e P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.435973 24921 ts_tablet_manager.cc:1434] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260808 20:00:23.436338 22831 leader_election.cc:304] T a065666fbe014e339992f3d0e4cb18d2 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:23.436573 23177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a065666fbe014e339992f3d0e4cb18d2" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9" is_pre_election: true
I20260808 20:00:23.436802 23177 raft_consensus.cc:2468] T a065666fbe014e339992f3d0e4cb18d2 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 0.
I20260808 20:00:23.438508 24387 raft_consensus.cc:2804] T a065666fbe014e339992f3d0e4cb18d2 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:23.438639 24387 raft_consensus.cc:493] T a065666fbe014e339992f3d0e4cb18d2 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:23.438759 24387 raft_consensus.cc:3060] T a065666fbe014e339992f3d0e4cb18d2 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:23.441566 24921 tablet_bootstrap.cc:492] T 5588a78091484cc2a3636e4e0f6d1c30 P 257c9c7e0c6c441593eac06beb31fa4e: Bootstrap starting.
I20260808 20:00:23.442260 24387 raft_consensus.cc:515] T a065666fbe014e339992f3d0e4cb18d2 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.443109 24387 leader_election.cc:290] T a065666fbe014e339992f3d0e4cb18d2 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 election: Requested vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923)
I20260808 20:00:23.436316 24919 ts_tablet_manager.cc:1434] T 27b71167912a4250a58941600e22488e P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 20:00:23.443626 23177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a065666fbe014e339992f3d0e4cb18d2" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9"
I20260808 20:00:23.443837 24919 tablet_bootstrap.cc:492] T 052275c6e1d34d9d9242718b4e803b48 P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:23.443888 23177 raft_consensus.cc:3060] T a065666fbe014e339992f3d0e4cb18d2 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:23.445580 24921 tablet_bootstrap.cc:654] T 5588a78091484cc2a3636e4e0f6d1c30 P 257c9c7e0c6c441593eac06beb31fa4e: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:23.445648 24919 tablet_bootstrap.cc:654] T 052275c6e1d34d9d9242718b4e803b48 P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:23.447386 22710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a065666fbe014e339992f3d0e4cb18d2" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e"
I20260808 20:00:23.447729 22710 raft_consensus.cc:3060] T a065666fbe014e339992f3d0e4cb18d2 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:23.448943 23177 raft_consensus.cc:2468] T a065666fbe014e339992f3d0e4cb18d2 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 1.
I20260808 20:00:23.449533 22835 leader_election.cc:304] T a065666fbe014e339992f3d0e4cb18d2 P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:23.449941 24387 raft_consensus.cc:2804] T a065666fbe014e339992f3d0e4cb18d2 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:23.450091 24387 raft_consensus.cc:697] T a065666fbe014e339992f3d0e4cb18d2 P e34d5caee97d44fa945a91ddc6a54653 [term 1 LEADER]: Becoming Leader. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Running, Role: LEADER
I20260808 20:00:23.450448 24387 consensus_queue.cc:237] T a065666fbe014e339992f3d0e4cb18d2 P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.450778 24919 tablet_bootstrap.cc:492] T 052275c6e1d34d9d9242718b4e803b48 P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:23.451009 24919 ts_tablet_manager.cc:1403] T 052275c6e1d34d9d9242718b4e803b48 P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.002s
I20260808 20:00:23.452277 24919 raft_consensus.cc:359] T 052275c6e1d34d9d9242718b4e803b48 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.452512 24919 raft_consensus.cc:385] T 052275c6e1d34d9d9242718b4e803b48 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:23.452592 24919 raft_consensus.cc:740] T 052275c6e1d34d9d9242718b4e803b48 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:23.452824 24919 consensus_queue.cc:260] T 052275c6e1d34d9d9242718b4e803b48 P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.453317 24919 ts_tablet_manager.cc:1434] T 052275c6e1d34d9d9242718b4e803b48 P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 20:00:23.453583 24919 tablet_bootstrap.cc:492] T 308609a3a4504bb5902009fd82d0775b P e34d5caee97d44fa945a91ddc6a54653: Bootstrap starting.
I20260808 20:00:23.455049 24919 tablet_bootstrap.cc:654] T 308609a3a4504bb5902009fd82d0775b P e34d5caee97d44fa945a91ddc6a54653: Neither blocks nor log segments found. Creating new log.
I20260808 20:00:23.458221 22710 raft_consensus.cc:2468] T a065666fbe014e339992f3d0e4cb18d2 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 1.
I20260808 20:00:23.460688 24921 tablet_bootstrap.cc:492] T 5588a78091484cc2a3636e4e0f6d1c30 P 257c9c7e0c6c441593eac06beb31fa4e: No bootstrap required, opened a new log
I20260808 20:00:23.460963 24921 ts_tablet_manager.cc:1403] T 5588a78091484cc2a3636e4e0f6d1c30 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.003s
I20260808 20:00:23.462230 24921 raft_consensus.cc:359] T 5588a78091484cc2a3636e4e0f6d1c30 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.462522 24921 raft_consensus.cc:385] T 5588a78091484cc2a3636e4e0f6d1c30 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:23.462647 24921 raft_consensus.cc:740] T 5588a78091484cc2a3636e4e0f6d1c30 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Initialized, Role: FOLLOWER
I20260808 20:00:23.462991 24921 consensus_queue.cc:260] T 5588a78091484cc2a3636e4e0f6d1c30 P 257c9c7e0c6c441593eac06beb31fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.465118 24921 ts_tablet_manager.cc:1434] T 5588a78091484cc2a3636e4e0f6d1c30 P 257c9c7e0c6c441593eac06beb31fa4e: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260808 20:00:23.467272 24919 tablet_bootstrap.cc:492] T 308609a3a4504bb5902009fd82d0775b P e34d5caee97d44fa945a91ddc6a54653: No bootstrap required, opened a new log
I20260808 20:00:23.467444 24919 ts_tablet_manager.cc:1403] T 308609a3a4504bb5902009fd82d0775b P e34d5caee97d44fa945a91ddc6a54653: Time spent bootstrapping tablet: real 0.014s user 0.012s sys 0.000s
I20260808 20:00:23.468202 24919 raft_consensus.cc:359] T 308609a3a4504bb5902009fd82d0775b P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.468415 24919 raft_consensus.cc:385] T 308609a3a4504bb5902009fd82d0775b P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 20:00:23.468515 24919 raft_consensus.cc:740] T 308609a3a4504bb5902009fd82d0775b P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Initialized, Role: FOLLOWER
I20260808 20:00:23.468801 24919 consensus_queue.cc:260] T 308609a3a4504bb5902009fd82d0775b P e34d5caee97d44fa945a91ddc6a54653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.469385 24919 ts_tablet_manager.cc:1434] T 308609a3a4504bb5902009fd82d0775b P e34d5caee97d44fa945a91ddc6a54653: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 20:00:23.536907 24870 raft_consensus.cc:493] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:23.537140 24870 raft_consensus.cc:515] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.537976 24870 leader_election.cc:290] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923)
I20260808 20:00:23.538687 22938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fabdfe3ddfa74b98a7cc870c4c8e9af6" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653" is_pre_election: true
I20260808 20:00:23.538722 22710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fabdfe3ddfa74b98a7cc870c4c8e9af6" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e" is_pre_election: true
I20260808 20:00:23.538923 22938 raft_consensus.cc:2468] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 0.
I20260808 20:00:23.539007 22710 raft_consensus.cc:2468] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 0.
I20260808 20:00:23.539579 23066 leader_election.cc:304] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:23.539880 24870 raft_consensus.cc:2804] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:23.540010 24870 raft_consensus.cc:493] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:23.540099 24870 raft_consensus.cc:3060] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:23.543035 24870 raft_consensus.cc:515] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.544209 22938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fabdfe3ddfa74b98a7cc870c4c8e9af6" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653"
I20260808 20:00:23.544378 24870 leader_election.cc:290] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 election: Requested vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923)
I20260808 20:00:23.544448 22938 raft_consensus.cc:3060] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:23.545253 22710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fabdfe3ddfa74b98a7cc870c4c8e9af6" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e"
I20260808 20:00:23.545501 22710 raft_consensus.cc:3060] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:23.547444 22938 raft_consensus.cc:2468] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 1.
I20260808 20:00:23.548043 23066 leader_election.cc:304] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:23.548413 24870 raft_consensus.cc:2804] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:23.548458 22710 raft_consensus.cc:2468] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 1.
I20260808 20:00:23.549089 24870 raft_consensus.cc:697] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 LEADER]: Becoming Leader. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Running, Role: LEADER
I20260808 20:00:23.549822 24870 consensus_queue.cc:237] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 5f6b6c2e318d44a984120a06a09e9af9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
W20260808 20:00:23.564857 22832 connection.cc:573] server connection from 127.0.0.1:55302 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 20:00:23.564857 23066 connection.cc:573] server connection from 127.0.0.1:35976 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 20:00:23.564908 22608 connection.cc:573] server connection from 127.0.0.1:53320 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 20:00:23.565156 22607 connection.cc:573] client connection to 127.21.36.126:43945 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 20:00:23.565224 23072 connection.cc:573] client connection to 127.21.36.126:43945 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 20:00:23.565230 22835 connection.cc:573] client connection to 127.21.36.126:43945 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 20:00:23.565878 23276 connection.cc:573] client connection to 127.21.36.126:43945 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 20:00:23.567057 23276 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.21.36.126:43945)
W20260808 20:00:23.567611 24730 negotiation.cc:336] Failed RPC negotiation. Trace:
0808 20:00:23.566384 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.21.36.126:43945 (local address 127.21.36.67:39501)
0808 20:00:23.566703 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0808 20:00:23.566721 (+ 18us) client_negotiation.cc:175] Beginning negotiation
0808 20:00:23.566842 (+ 121us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0808 20:00:23.567359 (+ 517us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":178}
W20260808 20:00:23.567955 24867 negotiation.cc:336] Failed RPC negotiation. Trace:
0808 20:00:23.566170 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.21.36.126:43945 (local address 127.21.36.65:56651)
0808 20:00:23.566479 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0808 20:00:23.566499 (+ 20us) client_negotiation.cc:175] Beginning negotiation
0808 20:00:23.566634 (+ 135us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0808 20:00:23.567702 (+ 1068us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":185}
W20260808 20:00:23.568795 24592 negotiation.cc:336] Failed RPC negotiation. Trace:
0808 20:00:23.567090 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.21.36.126:43945 (local address 127.21.36.66:59933)
0808 20:00:23.567299 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0808 20:00:23.567317 (+ 18us) client_negotiation.cc:175] Beginning negotiation
0808 20:00:23.567435 (+ 118us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0808 20:00:23.568578 (+ 1143us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":100}
W20260808 20:00:23.568962 23276 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.21.36.126:43945)
W20260808 20:00:23.569160 23276 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.21.36.126:43945)
W20260808 20:00:23.569358 23276 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.21.36.126:43945)
I20260808 20:00:23.611536 24930 raft_consensus.cc:493] T 052275c6e1d34d9d9242718b4e803b48 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:23.611754 24930 raft_consensus.cc:515] T 052275c6e1d34d9d9242718b4e803b48 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.612711 24930 leader_election.cc:290] T 052275c6e1d34d9d9242718b4e803b48 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:23.613461 23177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052275c6e1d34d9d9242718b4e803b48" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9" is_pre_election: true
I20260808 20:00:23.613456 22938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052275c6e1d34d9d9242718b4e803b48" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653" is_pre_election: true
I20260808 20:00:23.613690 23177 raft_consensus.cc:2468] T 052275c6e1d34d9d9242718b4e803b48 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 0.
I20260808 20:00:23.613706 22938 raft_consensus.cc:2468] T 052275c6e1d34d9d9242718b4e803b48 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 0.
I20260808 20:00:23.614207 22604 leader_election.cc:304] T 052275c6e1d34d9d9242718b4e803b48 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:23.614511 24930 raft_consensus.cc:2804] T 052275c6e1d34d9d9242718b4e803b48 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:23.614642 24930 raft_consensus.cc:493] T 052275c6e1d34d9d9242718b4e803b48 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:23.614732 24930 raft_consensus.cc:3060] T 052275c6e1d34d9d9242718b4e803b48 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:23.617945 24930 raft_consensus.cc:515] T 052275c6e1d34d9d9242718b4e803b48 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.619181 22938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052275c6e1d34d9d9242718b4e803b48" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653"
I20260808 20:00:23.619494 22938 raft_consensus.cc:3060] T 052275c6e1d34d9d9242718b4e803b48 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:23.620481 24930 leader_election.cc:290] T 052275c6e1d34d9d9242718b4e803b48 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 election: Requested vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:23.621091 23177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052275c6e1d34d9d9242718b4e803b48" candidate_uuid: "257c9c7e0c6c441593eac06beb31fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9"
I20260808 20:00:23.621345 23177 raft_consensus.cc:3060] T 052275c6e1d34d9d9242718b4e803b48 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:23.622712 22938 raft_consensus.cc:2468] T 052275c6e1d34d9d9242718b4e803b48 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 1.
I20260808 20:00:23.623314 22604 leader_election.cc:304] T 052275c6e1d34d9d9242718b4e803b48 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:23.623764 24930 raft_consensus.cc:2804] T 052275c6e1d34d9d9242718b4e803b48 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:23.623767 23177 raft_consensus.cc:2468] T 052275c6e1d34d9d9242718b4e803b48 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257c9c7e0c6c441593eac06beb31fa4e in term 1.
I20260808 20:00:23.623946 24930 raft_consensus.cc:697] T 052275c6e1d34d9d9242718b4e803b48 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 LEADER]: Becoming Leader. State: Replica: 257c9c7e0c6c441593eac06beb31fa4e, State: Running, Role: LEADER
I20260808 20:00:23.624294 24930 consensus_queue.cc:237] T 052275c6e1d34d9d9242718b4e803b48 P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.625695 24870 raft_consensus.cc:493] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:23.625967 24870 raft_consensus.cc:515] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.626783 24870 leader_election.cc:290] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923)
I20260808 20:00:23.627395 22938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b71167912a4250a58941600e22488e" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653" is_pre_election: true
I20260808 20:00:23.627717 22938 raft_consensus.cc:2468] T 27b71167912a4250a58941600e22488e P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 0.
I20260808 20:00:23.628232 23066 leader_election.cc:304] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:23.628230 22710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b71167912a4250a58941600e22488e" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e" is_pre_election: true
I20260808 20:00:23.628469 22710 raft_consensus.cc:2468] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 0.
I20260808 20:00:23.628572 24870 raft_consensus.cc:2804] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:23.628669 24870 raft_consensus.cc:493] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:23.628795 24870 raft_consensus.cc:3060] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:23.631418 24870 raft_consensus.cc:515] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.632112 24870 leader_election.cc:290] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 election: Requested vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923)
I20260808 20:00:23.632711 22710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b71167912a4250a58941600e22488e" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e"
I20260808 20:00:23.632932 22710 raft_consensus.cc:3060] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:23.632990 22938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b71167912a4250a58941600e22488e" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653"
I20260808 20:00:23.633183 22938 raft_consensus.cc:3060] T 27b71167912a4250a58941600e22488e P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:23.636117 22710 raft_consensus.cc:2468] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 1.
I20260808 20:00:23.636293 22938 raft_consensus.cc:2468] T 27b71167912a4250a58941600e22488e P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 1.
I20260808 20:00:23.636853 23066 leader_election.cc:304] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:23.637203 24870 raft_consensus.cc:2804] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:23.637388 24870 raft_consensus.cc:697] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 LEADER]: Becoming Leader. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Running, Role: LEADER
I20260808 20:00:23.637727 24870 consensus_queue.cc:237] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.643353 24991 raft_consensus.cc:493] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d2c4576401a74a60855647c956b195fd)
I20260808 20:00:23.643584 24991 raft_consensus.cc:515] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:23.644591 24991 leader_election.cc:290] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441)
W20260808 20:00:23.647300 24472 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:00:23.647598 24470 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441): Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
I20260808 20:00:23.647737 24470 leader_election.cc:304] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b91a1a84d6cd4038ac9d3ad2b8cf7979; no voters: 16a59d796024414abf9f82a7593530a6, d2c4576401a74a60855647c956b195fd
I20260808 20:00:23.648003 24991 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260808 20:00:23.709211 24387 raft_consensus.cc:493] T 308609a3a4504bb5902009fd82d0775b P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:23.709470 24387 raft_consensus.cc:515] T 308609a3a4504bb5902009fd82d0775b P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.710140 24387 leader_election.cc:290] T 308609a3a4504bb5902009fd82d0775b P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923)
I20260808 20:00:23.710813 22710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "308609a3a4504bb5902009fd82d0775b" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e" is_pre_election: true
I20260808 20:00:23.710834 23177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "308609a3a4504bb5902009fd82d0775b" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9" is_pre_election: true
I20260808 20:00:23.711064 22710 raft_consensus.cc:2468] T 308609a3a4504bb5902009fd82d0775b P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 0.
I20260808 20:00:23.711077 23177 raft_consensus.cc:2468] T 308609a3a4504bb5902009fd82d0775b P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 0.
I20260808 20:00:23.711629 22831 leader_election.cc:304] T 308609a3a4504bb5902009fd82d0775b P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:23.712013 24387 raft_consensus.cc:2804] T 308609a3a4504bb5902009fd82d0775b P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:23.712114 24387 raft_consensus.cc:493] T 308609a3a4504bb5902009fd82d0775b P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:23.712240 24387 raft_consensus.cc:3060] T 308609a3a4504bb5902009fd82d0775b P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:23.714318 24387 raft_consensus.cc:515] T 308609a3a4504bb5902009fd82d0775b P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.714987 24387 leader_election.cc:290] T 308609a3a4504bb5902009fd82d0775b P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 election: Requested vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923)
I20260808 20:00:23.715622 22710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "308609a3a4504bb5902009fd82d0775b" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e"
I20260808 20:00:23.715664 23177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "308609a3a4504bb5902009fd82d0775b" candidate_uuid: "e34d5caee97d44fa945a91ddc6a54653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f6b6c2e318d44a984120a06a09e9af9"
I20260808 20:00:23.715939 23177 raft_consensus.cc:3060] T 308609a3a4504bb5902009fd82d0775b P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:23.715948 22710 raft_consensus.cc:3060] T 308609a3a4504bb5902009fd82d0775b P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:23.718869 22710 raft_consensus.cc:2468] T 308609a3a4504bb5902009fd82d0775b P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 1.
I20260808 20:00:23.719529 22831 leader_election.cc:304] T 308609a3a4504bb5902009fd82d0775b P e34d5caee97d44fa945a91ddc6a54653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:23.719862 24387 raft_consensus.cc:2804] T 308609a3a4504bb5902009fd82d0775b P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:23.719967 23177 raft_consensus.cc:2468] T 308609a3a4504bb5902009fd82d0775b P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34d5caee97d44fa945a91ddc6a54653 in term 1.
I20260808 20:00:23.721745 24387 raft_consensus.cc:697] T 308609a3a4504bb5902009fd82d0775b P e34d5caee97d44fa945a91ddc6a54653 [term 1 LEADER]: Becoming Leader. State: Replica: e34d5caee97d44fa945a91ddc6a54653, State: Running, Role: LEADER
I20260808 20:00:23.722121 24387 consensus_queue.cc:237] T 308609a3a4504bb5902009fd82d0775b P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.793695 24995 raft_consensus.cc:493] T 55e7c93eae77489e9594c52cf22d4e45 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:23.793884 24995 raft_consensus.cc:515] T 55e7c93eae77489e9594c52cf22d4e45 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:23.794569 24995 leader_election.cc:290] T 55e7c93eae77489e9594c52cf22d4e45 P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923)
I20260808 20:00:23.795153 22938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e7c93eae77489e9594c52cf22d4e45" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653" is_pre_election: true
I20260808 20:00:23.795258 22710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e7c93eae77489e9594c52cf22d4e45" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e" is_pre_election: true
I20260808 20:00:23.795418 22938 raft_consensus.cc:2468] T 55e7c93eae77489e9594c52cf22d4e45 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 0.
I20260808 20:00:23.795547 22710 raft_consensus.cc:2468] T 55e7c93eae77489e9594c52cf22d4e45 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 0.
I20260808 20:00:23.795958 23066 leader_election.cc:304] T 55e7c93eae77489e9594c52cf22d4e45 P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:23.796272 24995 raft_consensus.cc:2804] T 55e7c93eae77489e9594c52cf22d4e45 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:23.796379 24995 raft_consensus.cc:493] T 55e7c93eae77489e9594c52cf22d4e45 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:23.796468 24995 raft_consensus.cc:3060] T 55e7c93eae77489e9594c52cf22d4e45 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:23.798949 24995 raft_consensus.cc:515] T 55e7c93eae77489e9594c52cf22d4e45 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:23.799628 24995 leader_election.cc:290] T 55e7c93eae77489e9594c52cf22d4e45 P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 election: Requested vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923)
I20260808 20:00:23.800186 22938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e7c93eae77489e9594c52cf22d4e45" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653"
I20260808 20:00:23.800272 22710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e7c93eae77489e9594c52cf22d4e45" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e"
I20260808 20:00:23.800429 22938 raft_consensus.cc:3060] T 55e7c93eae77489e9594c52cf22d4e45 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:23.800503 22710 raft_consensus.cc:3060] T 55e7c93eae77489e9594c52cf22d4e45 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:23.803011 22710 raft_consensus.cc:2468] T 55e7c93eae77489e9594c52cf22d4e45 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 1.
I20260808 20:00:23.803097 22938 raft_consensus.cc:2468] T 55e7c93eae77489e9594c52cf22d4e45 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 1.
I20260808 20:00:23.803499 23066 leader_election.cc:304] T 55e7c93eae77489e9594c52cf22d4e45 P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, 5f6b6c2e318d44a984120a06a09e9af9; no voters:
I20260808 20:00:23.803818 24995 raft_consensus.cc:2804] T 55e7c93eae77489e9594c52cf22d4e45 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:23.803977 24995 raft_consensus.cc:697] T 55e7c93eae77489e9594c52cf22d4e45 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 LEADER]: Becoming Leader. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Running, Role: LEADER
I20260808 20:00:23.804284 24995 consensus_queue.cc:237] T 55e7c93eae77489e9594c52cf22d4e45 P 5f6b6c2e318d44a984120a06a09e9af9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:23.928376 24995 raft_consensus.cc:493] T 5588a78091484cc2a3636e4e0f6d1c30 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:23.928618 24995 raft_consensus.cc:515] T 5588a78091484cc2a3636e4e0f6d1c30 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.929344 24995 leader_election.cc:290] T 5588a78091484cc2a3636e4e0f6d1c30 P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923)
I20260808 20:00:23.930089 22938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5588a78091484cc2a3636e4e0f6d1c30" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653" is_pre_election: true
I20260808 20:00:23.930079 22710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5588a78091484cc2a3636e4e0f6d1c30" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e" is_pre_election: true
I20260808 20:00:23.930353 22938 raft_consensus.cc:2468] T 5588a78091484cc2a3636e4e0f6d1c30 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 0.
I20260808 20:00:23.930377 22710 raft_consensus.cc:2468] T 5588a78091484cc2a3636e4e0f6d1c30 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 0.
I20260808 20:00:23.930905 23066 leader_election.cc:304] T 5588a78091484cc2a3636e4e0f6d1c30 P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e, 5f6b6c2e318d44a984120a06a09e9af9; no voters:
I20260808 20:00:23.931502 24995 raft_consensus.cc:2804] T 5588a78091484cc2a3636e4e0f6d1c30 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 20:00:23.931614 24995 raft_consensus.cc:493] T 5588a78091484cc2a3636e4e0f6d1c30 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:23.931723 24995 raft_consensus.cc:3060] T 5588a78091484cc2a3636e4e0f6d1c30 P 5f6b6c2e318d44a984120a06a09e9af9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:23.934705 24995 raft_consensus.cc:515] T 5588a78091484cc2a3636e4e0f6d1c30 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:23.935499 24995 leader_election.cc:290] T 5588a78091484cc2a3636e4e0f6d1c30 P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 election: Requested vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923)
I20260808 20:00:23.936149 22938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5588a78091484cc2a3636e4e0f6d1c30" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e34d5caee97d44fa945a91ddc6a54653"
I20260808 20:00:23.936378 22938 raft_consensus.cc:3060] T 5588a78091484cc2a3636e4e0f6d1c30 P e34d5caee97d44fa945a91ddc6a54653 [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:23.936678 22710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5588a78091484cc2a3636e4e0f6d1c30" candidate_uuid: "5f6b6c2e318d44a984120a06a09e9af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257c9c7e0c6c441593eac06beb31fa4e"
I20260808 20:00:23.936915 22710 raft_consensus.cc:3060] T 5588a78091484cc2a3636e4e0f6d1c30 P 257c9c7e0c6c441593eac06beb31fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 20:00:23.939437 22938 raft_consensus.cc:2468] T 5588a78091484cc2a3636e4e0f6d1c30 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 1.
I20260808 20:00:23.939787 22710 raft_consensus.cc:2468] T 5588a78091484cc2a3636e4e0f6d1c30 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f6b6c2e318d44a984120a06a09e9af9 in term 1.
I20260808 20:00:23.940152 23066 leader_election.cc:304] T 5588a78091484cc2a3636e4e0f6d1c30 P 5f6b6c2e318d44a984120a06a09e9af9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653; no voters:
I20260808 20:00:23.940476 24995 raft_consensus.cc:2804] T 5588a78091484cc2a3636e4e0f6d1c30 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 20:00:23.940662 24995 raft_consensus.cc:697] T 5588a78091484cc2a3636e4e0f6d1c30 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 LEADER]: Becoming Leader. State: Replica: 5f6b6c2e318d44a984120a06a09e9af9, State: Running, Role: LEADER
I20260808 20:00:23.941447 24995 consensus_queue.cc:237] T 5588a78091484cc2a3636e4e0f6d1c30 P 5f6b6c2e318d44a984120a06a09e9af9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
W20260808 20:00:24.179216 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 6: this message will repeat every 5th retry.
I20260808 20:00:24.206694 25013 raft_consensus.cc:493] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d2c4576401a74a60855647c956b195fd)
I20260808 20:00:24.206887 25013 raft_consensus.cc:515] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:24.207605 25013 leader_election.cc:290] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441)
I20260808 20:00:24.208981 24435 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:00:24.209199 24435 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:00:24.209708 24470 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441): Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
W20260808 20:00:24.209925 24472 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
I20260808 20:00:24.210132 24472 leader_election.cc:304] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b91a1a84d6cd4038ac9d3ad2b8cf7979; no voters: 16a59d796024414abf9f82a7593530a6, d2c4576401a74a60855647c956b195fd
I20260808 20:00:24.210492 25013 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260808 20:00:24.276074 25003 consensus_queue.cc:1048] T a065666fbe014e339992f3d0e4cb18d2 P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:24.282857 25027 consensus_queue.cc:1048] T a065666fbe014e339992f3d0e4cb18d2 P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:24.392745 24928 consensus_queue.cc:1048] T 052275c6e1d34d9d9242718b4e803b48 P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:24.397640 24930 consensus_queue.cc:1048] T 052275c6e1d34d9d9242718b4e803b48 P 257c9c7e0c6c441593eac06beb31fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:24.446887 24995 consensus_queue.cc:1048] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 5f6b6c2e318d44a984120a06a09e9af9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:24.454420 25041 consensus_queue.cc:1048] T fabdfe3ddfa74b98a7cc870c4c8e9af6 P 5f6b6c2e318d44a984120a06a09e9af9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:24.481678 24930 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:00:24.481913 24930 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:24.482930 24930 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:00:24.484443 22607 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
W20260808 20:00:24.484644 22604 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:00:24.484755 22604 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:00:24.485041 24930 raft_consensus.cc:2749] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:00:24.572058 25038 consensus_queue.cc:1048] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:24.579854 24995 consensus_queue.cc:1048] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:24.599382 25003 consensus_queue.cc:1048] T 308609a3a4504bb5902009fd82d0775b P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:24.608050 25003 consensus_queue.cc:1048] T 308609a3a4504bb5902009fd82d0775b P e34d5caee97d44fa945a91ddc6a54653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:24.715909 25038 consensus_queue.cc:1048] T 5588a78091484cc2a3636e4e0f6d1c30 P 5f6b6c2e318d44a984120a06a09e9af9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:24.721695 25041 consensus_queue.cc:1048] T 5588a78091484cc2a3636e4e0f6d1c30 P 5f6b6c2e318d44a984120a06a09e9af9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:24.740083 21649 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu pid 24435
I20260808 20:00:24.743789 24995 consensus_queue.cc:1048] T 55e7c93eae77489e9594c52cf22d4e45 P 5f6b6c2e318d44a984120a06a09e9af9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:24.751286 25038 consensus_queue.cc:1048] T 55e7c93eae77489e9594c52cf22d4e45 P 5f6b6c2e318d44a984120a06a09e9af9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 20:00:24.754285 24544 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 20:00:24.874836 21649 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu with pid 24435
I20260808 20:00:25.184764 24928 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:00:25.185114 24928 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:25.185936 24928 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:00:25.187176 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:00:25.187393 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:00:25.187597 22607 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:00:25.187916 24928 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:00:25.225361 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 6: this message will repeat every 5th retry.
I20260808 20:00:25.762185 21649 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu
/tmp/dist-test-taskNcG5N9/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.36.124:34593
--webserver_interface=127.21.36.124
--webserver_port=40825
--builtin_ntp_servers=127.21.36.84:34883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593
--hive_metastore_uris=thrift://127.0.0.1:44789
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260808 20:00:26.151927 25092 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 20:00:26.152289 25092 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 20:00:26.152405 25092 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260808 20:00:26.161804 25092 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 20:00:26.161927 25092 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260808 20:00:26.162012 25092 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 20:00:26.162078 25092 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260808 20:00:26.173632 25092 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.36.84:34883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:44789
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.36.124:34593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.21.36.124
--webserver_port=40825
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 08 Aug 2026 19:43:23 UTC on bdcb31816ec0
build id 13246
ASAN enabled
I20260808 20:00:26.175374 25092 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 20:00:26.177392 25092 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 20:00:26.186885 25113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 20:00:26.186993 25109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 20:00:26.187881 25116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 20:00:26.188476 25092 server_base.cc:1061] running on GCE node
I20260808 20:00:26.189411 25092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 20:00:26.191016 25092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 20:00:26.192258 25092 hybrid_clock.cc:648] HybridClock initialized: now 1786219226192195 us; error 59 us; skew 500 ppm
I20260808 20:00:26.192709 25092 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 20:00:26.195562 25092 webserver.cc:533] Webserver started at http://127.21.36.124:40825/ using document root <none> and password file <none>
I20260808 20:00:26.196363 25092 fs_manager.cc:362] Metadata directory not provided
I20260808 20:00:26.196470 25092 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 20:00:26.202527 25092 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260808 20:00:26.206220 25126 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 20:00:26.207917 25092 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 20:00:26.208274 25092 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/data,/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/wal
uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979"
format_stamp: "Formatted at 2026-08-08 20:00:05 on dist-test-slave-pww0"
I20260808 20:00:26.209158 25092 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 20:00:26.233584 25092 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 20:00:26.234575 25092 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 20:00:26.234889 25092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 20:00:26.262876 25092 rpc_server.cc:307] RPC server started. Bound to: 127.21.36.124:34593
I20260808 20:00:26.262898 25210 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.36.124:34593 every 8 connection(s)
I20260808 20:00:26.265030 25092 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/data/info.pb
I20260808 20:00:26.271939 21649 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu as pid 25092
I20260808 20:00:26.273414 25211 sys_catalog.cc:263] Verifying existing consensus state
I20260808 20:00:26.278837 25211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: Bootstrap starting.
I20260808 20:00:26.301304 25211 log.cc:826] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: Log is configured to *not* fsync() on all Append() calls
I20260808 20:00:26.366848 23254 heartbeater.cc:344] Connected to a master server at 127.21.36.124:34593
I20260808 20:00:26.383651 25211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: Bootstrap replayed 1/1 log segments. Stats: ops{read=103 overwritten=0 applied=103 ignored=0} inserts{seen=67 ignored=0} mutations{seen=82 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 20:00:26.384364 25211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: Bootstrap complete.
I20260808 20:00:26.392402 22791 heartbeater.cc:344] Connected to a master server at 127.21.36.124:34593
I20260808 20:00:26.392455 25211 raft_consensus.cc:359] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 7 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:26.393239 25211 raft_consensus.cc:740] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 7 FOLLOWER]: Becoming Follower/Learner. State: Replica: b91a1a84d6cd4038ac9d3ad2b8cf7979, State: Initialized, Role: FOLLOWER
I20260808 20:00:26.394066 25211 consensus_queue.cc:260] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 103, Last appended: 7.103, Last appended by leader: 103, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:26.395093 25230 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:26.395403 25230 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:26.396201 25211 sys_catalog.cc:565] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 20:00:26.405798 25092 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:00:26.411387 25092 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:00:26.416798 25247 catalog_manager.cc:1295] Loaded cluster ID: 9c4ad126d38943188e9e4422f5e27418
I20260808 20:00:26.416901 25247 catalog_manager.cc:1588] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: loading cluster ID for follower catalog manager: success
I20260808 20:00:26.420434 25247 catalog_manager.cc:1610] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: acquiring CA information for follower catalog manager: success
I20260808 20:00:26.422967 25247 catalog_manager.cc:1638] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 20:00:26.561715 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 6: this message will repeat every 5th retry.
I20260808 20:00:26.563326 25150 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" instance_seqno: 1786219208132788) as {username='slave'} at 127.21.36.67:56257; Asking this server to re-register.
I20260808 20:00:26.564317 23254 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:26.566888 25150 ts_manager.cc:194] Registered new tserver with Master: 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:26.625759 23016 heartbeater.cc:344] Connected to a master server at 127.21.36.124:34593
I20260808 20:00:26.628257 25150 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" instance_seqno: 1786219207598982) as {username='slave'} at 127.21.36.66:50647; Asking this server to re-register.
I20260808 20:00:26.628955 23016 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:26.630887 25150 ts_manager.cc:194] Registered new tserver with Master: e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:26.897619 25150 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" instance_seqno: 1786219207065397) as {username='slave'} at 127.21.36.65:60439; Asking this server to re-register.
I20260808 20:00:26.898509 22791 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:26.900388 25150 ts_manager.cc:194] Registered new tserver with Master: 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923)
I20260808 20:00:26.992379 25267 raft_consensus.cc:493] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:26.992640 25267 raft_consensus.cc:515] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:26.994542 25267 leader_election.cc:290] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441)
W20260808 20:00:26.995585 25132 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:00:26.997067 25132 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:00:26.997309 25130 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441): Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
I20260808 20:00:26.997457 25130 leader_election.cc:304] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b91a1a84d6cd4038ac9d3ad2b8cf7979; no voters: 16a59d796024414abf9f82a7593530a6, d2c4576401a74a60855647c956b195fd
I20260808 20:00:26.997818 25267 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260808 20:00:27.067024 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 6: this message will repeat every 5th retry.
I20260808 20:00:27.556766 25295 raft_consensus.cc:493] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:27.557003 25295 raft_consensus.cc:515] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:27.557775 25295 leader_election.cc:290] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441)
W20260808 20:00:27.560180 25132 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:00:27.560406 25130 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441): Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
I20260808 20:00:27.560534 25130 leader_election.cc:304] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b91a1a84d6cd4038ac9d3ad2b8cf7979; no voters: 16a59d796024414abf9f82a7593530a6, d2c4576401a74a60855647c956b195fd
I20260808 20:00:27.560827 25295 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260808 20:00:28.606299 25318 raft_consensus.cc:493] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:28.606500 25318 raft_consensus.cc:515] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:28.607328 25318 leader_election.cc:290] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441)
W20260808 20:00:28.610188 25132 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:00:28.610463 25130 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441): Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
I20260808 20:00:28.610592 25130 leader_election.cc:304] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b91a1a84d6cd4038ac9d3ad2b8cf7979; no voters: 16a59d796024414abf9f82a7593530a6, d2c4576401a74a60855647c956b195fd
I20260808 20:00:28.610855 25318 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260808 20:00:29.227433 21649 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu
/tmp/dist-test-taskNcG5N9/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.36.126:43945
--webserver_interface=127.21.36.126
--webserver_port=37243
--builtin_ntp_servers=127.21.36.84:34883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593
--hive_metastore_uris=thrift://127.0.0.1:44789
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260808 20:00:29.589498 25349 raft_consensus.cc:493] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:29.589697 25349 raft_consensus.cc:515] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:29.590514 25349 leader_election.cc:290] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441)
W20260808 20:00:29.592857 25132 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:00:29.593389 25130 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441): Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
I20260808 20:00:29.593540 25130 leader_election.cc:304] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b91a1a84d6cd4038ac9d3ad2b8cf7979; no voters: 16a59d796024414abf9f82a7593530a6, d2c4576401a74a60855647c956b195fd
I20260808 20:00:29.593866 25349 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260808 20:00:29.606276 25347 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 20:00:29.606632 25347 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 20:00:29.606745 25347 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260808 20:00:29.619153 25347 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 20:00:29.619318 25347 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260808 20:00:29.619405 25347 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 20:00:29.619501 25347 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260808 20:00:29.636745 25347 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.36.84:34883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:44789
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.36.126:43945
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.36.126
--webserver_port=37243
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 08 Aug 2026 19:43:23 UTC on bdcb31816ec0
build id 13246
ASAN enabled
I20260808 20:00:29.639292 25347 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 20:00:29.641968 25347 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 20:00:29.653622 25372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 20:00:29.655252 25375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 20:00:29.655325 25373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 20:00:29.656347 25347 server_base.cc:1061] running on GCE node
I20260808 20:00:29.657307 25347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 20:00:29.659101 25347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 20:00:29.660354 25347 hybrid_clock.cc:648] HybridClock initialized: now 1786219229660284 us; error 62 us; skew 500 ppm
I20260808 20:00:29.660995 25347 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 20:00:29.671015 25347 webserver.cc:533] Webserver started at http://127.21.36.126:37243/ using document root <none> and password file <none>
I20260808 20:00:29.672053 25347 fs_manager.cc:362] Metadata directory not provided
I20260808 20:00:29.672206 25347 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 20:00:29.678511 25347 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 20:00:29.681989 25394 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 20:00:29.683717 25347 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 20:00:29.683931 25347 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data,/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/wal
uuid: "d2c4576401a74a60855647c956b195fd"
format_stamp: "Formatted at 2026-08-08 20:00:04 on dist-test-slave-pww0"
I20260808 20:00:29.684768 25347 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 20:00:29.708235 25347 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 20:00:29.709259 25347 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 20:00:29.709600 25347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 20:00:29.732194 25347 rpc_server.cc:307] RPC server started. Bound to: 127.21.36.126:43945
I20260808 20:00:29.732208 25494 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.36.126:43945 every 8 connection(s)
I20260808 20:00:29.734095 25347 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-0/data/info.pb
I20260808 20:00:29.734963 21649 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu as pid 25347
I20260808 20:00:29.743256 25495 sys_catalog.cc:263] Verifying existing consensus state
I20260808 20:00:29.748453 25495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Bootstrap starting.
I20260808 20:00:29.769778 22794 heartbeater.cc:344] Connected to a master server at 127.21.36.126:43945
I20260808 20:00:29.774976 25495 log.cc:826] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Log is configured to *not* fsync() on all Append() calls
I20260808 20:00:29.855777 25495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Bootstrap replayed 1/1 log segments. Stats: ops{read=103 overwritten=0 applied=103 ignored=0} inserts{seen=67 ignored=0} mutations{seen=82 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 20:00:29.856336 25495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Bootstrap complete.
I20260808 20:00:29.862066 25495 raft_consensus.cc:359] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 7 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:29.862879 25495 raft_consensus.cc:740] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 7 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2c4576401a74a60855647c956b195fd, State: Initialized, Role: FOLLOWER
I20260808 20:00:29.863608 25495 consensus_queue.cc:260] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 103, Last appended: 7.103, Last appended by leader: 103, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:29.864454 25506 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:29.864771 25506 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:29.865543 25495 sys_catalog.cc:565] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 20:00:29.882994 25527 catalog_manager.cc:1295] Loaded cluster ID: 9c4ad126d38943188e9e4422f5e27418
I20260808 20:00:29.883222 25527 catalog_manager.cc:1588] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: loading cluster ID for follower catalog manager: success
I20260808 20:00:29.892402 25527 catalog_manager.cc:1610] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: acquiring CA information for follower catalog manager: success
I20260808 20:00:29.886723 25347 master_runner.cc:187] Error getting master registration for 127.21.36.125:36441: Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111),
I20260808 20:00:29.893023 25347 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:00:29.895095 25527 catalog_manager.cc:1638] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 20:00:30.068800 23256 heartbeater.cc:344] Connected to a master server at 127.21.36.126:43945
I20260808 20:00:30.072093 25428 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" instance_seqno: 1786219208132788) as {username='slave'} at 127.21.36.67:59757; Asking this server to re-register.
I20260808 20:00:30.072997 23256 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:30.075335 25428 ts_manager.cc:194] Registered new tserver with Master: 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:30.150580 23017 heartbeater.cc:344] Connected to a master server at 127.21.36.126:43945
I20260808 20:00:30.153720 25428 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" instance_seqno: 1786219207598982) as {username='slave'} at 127.21.36.66:46975; Asking this server to re-register.
I20260808 20:00:30.154677 23017 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:30.157006 25428 ts_manager.cc:194] Registered new tserver with Master: e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:30.277756 25428 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" instance_seqno: 1786219207065397) as {username='slave'} at 127.21.36.65:41039; Asking this server to re-register.
I20260808 20:00:30.278774 22794 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:30.280817 25428 ts_manager.cc:194] Registered new tserver with Master: 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923)
I20260808 20:00:30.379621 25544 raft_consensus.cc:493] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:30.380005 25544 raft_consensus.cc:515] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:30.382052 25544 leader_election.cc:290] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:00:30.383173 25395 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
W20260808 20:00:30.385030 25395 leader_election.cc:336] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441): Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
I20260808 20:00:30.389389 25165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d2c4576401a74a60855647c956b195fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 103 } } ignore_live_leader: false dest_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" is_pre_election: true
I20260808 20:00:30.389932 25165 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2c4576401a74a60855647c956b195fd in term 7.
I20260808 20:00:30.390621 25396 leader_election.cc:304] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd; no voters: 16a59d796024414abf9f82a7593530a6
I20260808 20:00:30.391062 25544 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260808 20:00:30.391233 25544 raft_consensus.cc:493] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:30.391341 25544 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 7 FOLLOWER]: Advancing to term 8
I20260808 20:00:30.395249 25544 raft_consensus.cc:515] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:30.395993 25544 leader_election.cc:290] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 8 election: Requested vote from peers 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
I20260808 20:00:30.396685 25165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d2c4576401a74a60855647c956b195fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 103 } } ignore_live_leader: false dest_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979"
I20260808 20:00:30.396934 25165 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 7 FOLLOWER]: Advancing to term 8
W20260808 20:00:30.397686 25395 leader_election.cc:336] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441): Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
I20260808 20:00:30.401458 25165 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2c4576401a74a60855647c956b195fd in term 8.
I20260808 20:00:30.402045 25396 leader_election.cc:304] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd; no voters: 16a59d796024414abf9f82a7593530a6
I20260808 20:00:30.402400 25544 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 8 FOLLOWER]: Leader election won for term 8
I20260808 20:00:30.402840 25544 raft_consensus.cc:697] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [term 8 LEADER]: Becoming Leader. State: Replica: d2c4576401a74a60855647c956b195fd, State: Running, Role: LEADER
I20260808 20:00:30.403322 25544 consensus_queue.cc:237] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 103, Committed index: 103, Last appended: 7.103, Last appended by leader: 103, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:30.406256 25550 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2c4576401a74a60855647c956b195fd. Latest consensus state: current_term: 8 leader_uuid: "d2c4576401a74a60855647c956b195fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:30.406525 25550 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: This master's current role is: LEADER
I20260808 20:00:30.407155 25552 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 20:00:30.409930 25552 catalog_manager.cc:679] Loaded metadata for table default.table_f7a6e8903ed74dc088eb1f490788c54b [id=0145ea517a7a4aec99304181d1c6cb28]
I20260808 20:00:30.410429 25552 catalog_manager.cc:679] Loaded metadata for table default.table_324c660111c84a72a6935eb8e30a7ae6 [id=06447c1e53ac4366baae14ef41588d7f]
I20260808 20:00:30.410792 25552 catalog_manager.cc:679] Loaded metadata for table default.table_61bf42c8286347d197162895f70520d7 [id=08230c16ec604c259195bbfa0c062164]
I20260808 20:00:30.411123 25552 catalog_manager.cc:679] Loaded metadata for table default.table_3ffa098d41af4ebb987cec463feb8e76 [id=1042ec7801c740c09255102bf01b8fd2]
I20260808 20:00:30.411451 25552 catalog_manager.cc:679] Loaded metadata for table default.table_4dc166b247ee4cf89cdd926e07b51a51 [id=355ea74a32ec4502b6679611e8c8b67e]
I20260808 20:00:30.411983 25552 catalog_manager.cc:679] Loaded metadata for table default.table_752d0310c94b42d3902fffa1070bb1d4 [id=3b10ed2d37fe46a5b63d646901474c8e]
I20260808 20:00:30.412318 25552 catalog_manager.cc:679] Loaded metadata for table default.table_4ed5029dcfbd499db24fb72e6b389d42 [id=43498092c52a457d93f97ba0993e6012]
I20260808 20:00:30.412662 25552 catalog_manager.cc:679] Loaded metadata for table default.table_732a1b16caff489aa844bba46e6ec1cb [id=524bfe483c7f4c4d99d2757ff290c5eb]
I20260808 20:00:30.412981 25552 catalog_manager.cc:679] Loaded metadata for table default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528]
I20260808 20:00:30.413347 25552 catalog_manager.cc:679] Loaded metadata for table default.table_42e6672ee7be4c4389fcc998d6eb322d [id=67d34c9d2f51445e8cf367f41abbcc28]
I20260808 20:00:30.413710 25552 catalog_manager.cc:679] Loaded metadata for table default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619]
I20260808 20:00:30.414093 25552 catalog_manager.cc:679] Loaded metadata for table default.table_1cd24efa52a547cc872dd7ffe4938fb8 [id=87fca666b411494c8486baf1bfa58327]
I20260808 20:00:30.414458 25552 catalog_manager.cc:679] Loaded metadata for table default.table_5a92fa3792a1443f94a707060264359c [id=89520ebff12347f18df06b25577ecf63]
I20260808 20:00:30.414822 25552 catalog_manager.cc:679] Loaded metadata for table default.table_530ab728450b4272b3e9573534afe4e6 [id=8c917809771f4262811b9f200ff0e925]
I20260808 20:00:30.415139 25552 catalog_manager.cc:679] Loaded metadata for table default.table_583f1fdac11148488799008b032f7ef2 [id=99b11a3c5ca3411b8c1800c70f61597a]
I20260808 20:00:30.415553 25552 catalog_manager.cc:679] Loaded metadata for table default.table_831d17f2742e4fb8bc727d56fc9d1c85 [id=b47087e2cd6349b1ba2b8daf55b2d1d5]
I20260808 20:00:30.415907 25552 catalog_manager.cc:679] Loaded metadata for table default.table_ba9e157aaf3a487eb4f3f2ec9c37b761 [id=edaf172891fe4dafbc1b00bbb27d9c1c]
I20260808 20:00:30.416250 25552 catalog_manager.cc:679] Loaded metadata for table default.table_01314a1f924d4e33bdecf8797a6e2e0a [id=fb4aaf09a463481d9f5512884b9574d7]
I20260808 20:00:30.418162 25552 tablet_loader.cc:96] loaded metadata for tablet 052275c6e1d34d9d9242718b4e803b48 (table default.table_f7a6e8903ed74dc088eb1f490788c54b [id=0145ea517a7a4aec99304181d1c6cb28])
I20260808 20:00:30.418776 25552 tablet_loader.cc:96] loaded metadata for tablet 1f1032c7852540c9bda3a1c37cd4bc9f (table default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619])
I20260808 20:00:30.419071 25552 tablet_loader.cc:96] loaded metadata for tablet 2086c55bb74a4997bcc9a49205ecf0f5 (table default.table_01314a1f924d4e33bdecf8797a6e2e0a [id=fb4aaf09a463481d9f5512884b9574d7])
I20260808 20:00:30.419368 25552 tablet_loader.cc:96] loaded metadata for tablet 2523719318f84e31862e40d76f9a23f5 (table default.table_5a92fa3792a1443f94a707060264359c [id=89520ebff12347f18df06b25577ecf63])
I20260808 20:00:30.419697 25552 tablet_loader.cc:96] loaded metadata for tablet 27b71167912a4250a58941600e22488e (table default.table_583f1fdac11148488799008b032f7ef2 [id=99b11a3c5ca3411b8c1800c70f61597a])
I20260808 20:00:30.420100 25552 tablet_loader.cc:96] loaded metadata for tablet 286e98ffe9b44ada92fd8e9776578df2 (table default.table_732a1b16caff489aa844bba46e6ec1cb [id=524bfe483c7f4c4d99d2757ff290c5eb])
I20260808 20:00:30.420644 25552 tablet_loader.cc:96] loaded metadata for tablet 308609a3a4504bb5902009fd82d0775b (table default.table_1cd24efa52a547cc872dd7ffe4938fb8 [id=87fca666b411494c8486baf1bfa58327])
I20260808 20:00:30.421535 25552 tablet_loader.cc:96] loaded metadata for tablet 5588a78091484cc2a3636e4e0f6d1c30 (table default.table_3ffa098d41af4ebb987cec463feb8e76 [id=1042ec7801c740c09255102bf01b8fd2])
I20260808 20:00:30.421926 25552 tablet_loader.cc:96] loaded metadata for tablet 55cf64ca16df4afbae5f58843f613f27 (table default.table_530ab728450b4272b3e9573534afe4e6 [id=8c917809771f4262811b9f200ff0e925])
I20260808 20:00:30.422253 25552 tablet_loader.cc:96] loaded metadata for tablet 55e7c93eae77489e9594c52cf22d4e45 (table default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528])
I20260808 20:00:30.422534 25552 tablet_loader.cc:96] loaded metadata for tablet 57c91cdb20e74754b418cbc9af674632 (table default.table_42e6672ee7be4c4389fcc998d6eb322d [id=67d34c9d2f51445e8cf367f41abbcc28])
I20260808 20:00:30.422824 25552 tablet_loader.cc:96] loaded metadata for tablet 5d0d61aef7854aa49fe36f2f505207b7 (table default.table_4dc166b247ee4cf89cdd926e07b51a51 [id=355ea74a32ec4502b6679611e8c8b67e])
I20260808 20:00:30.424053 25552 tablet_loader.cc:96] loaded metadata for tablet 9b63e4c056f34242aacef5ffafb14b25 (table default.table_ba9e157aaf3a487eb4f3f2ec9c37b761 [id=edaf172891fe4dafbc1b00bbb27d9c1c])
I20260808 20:00:30.424347 25552 tablet_loader.cc:96] loaded metadata for tablet a065666fbe014e339992f3d0e4cb18d2 (table default.table_61bf42c8286347d197162895f70520d7 [id=08230c16ec604c259195bbfa0c062164])
I20260808 20:00:30.424917 25552 tablet_loader.cc:96] loaded metadata for tablet b45729e2ec9e4a77b8be89f9657b0424 (table default.table_4ed5029dcfbd499db24fb72e6b389d42 [id=43498092c52a457d93f97ba0993e6012])
I20260808 20:00:30.425225 25552 tablet_loader.cc:96] loaded metadata for tablet b8948ef8ed844727b9fed1e91d9233f6 (table default.table_324c660111c84a72a6935eb8e30a7ae6 [id=06447c1e53ac4366baae14ef41588d7f])
I20260808 20:00:30.425503 25552 tablet_loader.cc:96] loaded metadata for tablet c75913753d95447783b9b7c7bb6ee701 (table default.table_752d0310c94b42d3902fffa1070bb1d4 [id=3b10ed2d37fe46a5b63d646901474c8e])
I20260808 20:00:30.426360 25552 tablet_loader.cc:96] loaded metadata for tablet fabdfe3ddfa74b98a7cc870c4c8e9af6 (table default.table_831d17f2742e4fb8bc727d56fc9d1c85 [id=b47087e2cd6349b1ba2b8daf55b2d1d5])
I20260808 20:00:30.426640 25552 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 20:00:30.427917 25552 catalog_manager.cc:1295] Loaded cluster ID: 9c4ad126d38943188e9e4422f5e27418
I20260808 20:00:30.427997 25552 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 20:00:30.429478 25552 catalog_manager.cc:1540] Loading token signing keys...
I20260808 20:00:30.430537 25552 catalog_manager.cc:6103] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Loaded TSK: 0
I20260808 20:00:30.431517 25552 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 20:00:30.432616 25552 catalog_manager.cc:1563] Loading latest processed Hive Metastore notification log event ID...
I20260808 20:00:30.433672 25552 catalog_manager.cc:5941] Last processed Hive Metastore notification event ID: 20
I20260808 20:00:30.477125 25543 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:00:30.477339 25543 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:30.478251 25543 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:00:30.479318 22607 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
W20260808 20:00:30.479550 22604 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:00:30.479693 22604 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:00:30.479986 25543 raft_consensus.cc:2749] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:00:30.500347 25428 master_service.cc:960] ReplaceTablet: received request to replace tablet d1c720d7dc8e4b8184ffc863a22cf9e3 from {username='slave'} at 127.0.0.1:58424
I20260808 20:00:30.500571 25426 master_service.cc:960] ReplaceTablet: received request to replace tablet c75913753d95447783b9b7c7bb6ee701 from {username='slave'} at 127.0.0.1:58424
I20260808 20:00:30.500934 25419 master_service.cc:960] ReplaceTablet: received request to replace tablet 2523719318f84e31862e40d76f9a23f5 from {username='slave'} at 127.0.0.1:58424
I20260808 20:00:30.501113 25425 master_service.cc:960] ReplaceTablet: received request to replace tablet 27b71167912a4250a58941600e22488e from {username='slave'} at 127.0.0.1:58424
I20260808 20:00:30.500959 25423 master_service.cc:960] ReplaceTablet: received request to replace tablet 55cf64ca16df4afbae5f58843f613f27 from {username='slave'} at 127.0.0.1:58424
I20260808 20:00:30.502281 25412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58424:
name: "default.Table_ff7235c5324648b08463994f0b2fd91e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:30.502856 25411 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58424:
table { table_name: "default.Table_732a1b16caff489aa844bba46e6ec1cb" } new_table_name: "default.Table_ff8fd7fa6c944c55bf82a9babe8329b9" modify_external_catalogs: true
I20260808 20:00:30.505496 25406 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58424:
name: "default.Table_82b7aebd4f7e489a9d1a0195c22a240e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:30.506896 25428 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58424:
name: "default.Table_c327e82406e546f3be21f09b629548c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:30.505571 25408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58424:
name: "default.Table_8c377b83d1df43b59266a3da79324d5f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:30.507018 25414 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58424:
table { table_name: "default.Table_831d17f2742e4fb8bc727d56fc9d1c85" } modify_external_catalogs: true
I20260808 20:00:30.507854 25414 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58424:
table { table_name: "default.Table_831d17f2742e4fb8bc727d56fc9d1c85" } modify_external_catalogs: true
I20260808 20:00:30.511675 25165 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Refusing update from remote peer d2c4576401a74a60855647c956b195fd: Log matching property violated. Preceding OpId in replica: term: 7 index: 103. Preceding OpId from leader: term: 8 index: 105. (index mismatch)
I20260808 20:00:30.513037 25544 consensus_queue.cc:1048] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 104, Last known committed idx: 103, Time since last communication: 0.000s
W20260808 20:00:30.514643 25395 consensus_peers.cc:597] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd -> Peer 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441): Couldn't send request to peer 16a59d796024414abf9f82a7593530a6. Status: Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
F20260808 20:00:30.517508 25526 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 27, previous 27; dumping first 8 out of 15 received events: NotificationEvent(eventId=21, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_831d17f2742e4fb8bc727d56fc9d1c85, message={"server":"","servicePrincipal":"","db":"default","table":"table_831d17f2742e4fb8bc727d56fc9d1c85","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_831d17f2742e4fb8bc727d56fc9d1c85\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219209},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_831d17f2742e4fb8bc727d56fc9d1c85\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_831d17f2742e4fb8bc727d56fc9d1c85\",\"kudu.table_id\":\"b47087e2cd6349b1ba2b8daf55b2d1d5\",\"transient_lastDdlTime\":\"1786219209\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=22, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_752d0310c94b42d3902fffa1070bb1d4, message={"server":"","servicePrincipal":"","db":"default","table":"table_752d0310c94b42d3902fffa1070bb1d4","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_752d0310c94b42d3902fffa1070bb1d4\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219209},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_752d0310c94b42d3902fffa1070bb1d4\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_752d0310c94b42d3902fffa1070bb1d4\",\"kudu.table_id\":\"3b10ed2d37fe46a5b63d646901474c8e\",\"transient_lastDdlTime\":\"1786219209\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1786219212, eventType=CREATE_TABLE, dbName=default, tableName=table_aa0809b208774982934a9f8de43aecf5, message={"server":"","servicePrincipal":"","db":"default","table":"table_aa0809b208774982934a9f8de43aecf5","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_aa0809b208774982934a9f8de43aecf5\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219212},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_aa0809b208774982934a9f8de43aecf5\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_aa0809b208774982934a9f8de43aecf5\",\"kudu.table_id\":\"1ba38449531f437d8795f5e35a3f9479\",\"transient_lastDdlTime\":\"1786219212\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=24, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_4dc166b247ee4cf89cdd926e07b51a51, message={"server":"","servicePrincipal":"","db":"default","table":"table_4dc166b247ee4cf89cdd926e07b51a51","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_4dc166b247ee4cf89cdd926e07b51a51\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219210},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_4dc166b247ee4cf89cdd926e07b51a51\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_4dc166b247ee4cf89cdd926e07b51a51\",\"kudu.table_id\":\"355ea74a32ec4502b6679611e8c8b67e\",\"transient_lastDdlTime\":\"1786219210\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=25, eventTime=1786219212, eventType=CREATE_TABLE, dbName=default, tableName=table_bfc21652528345b883ecf7962d128fee, message={"server":"","servicePrincipal":"","db":"default","table":"table_bfc21652528345b883ecf7962d128fee","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_bfc21652528345b883ecf7962d128fee\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219212},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_bfc21652528345b883ecf7962d128fee\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_bfc21652528345b883ecf7962d128fee\",\"kudu.table_id\":\"95d1dc4138bd491da51e09440dab7eee\",\"transient_lastDdlTime\":\"1786219212\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=26, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_324c660111c84a72a6935eb8e30a7ae6, message={"server":"","servicePrincipal":"","db":"default","table":"table_324c660111c84a72a6935eb8e30a7ae6","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_324c660111c84a72a6935eb8e30a7ae6\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219209},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_324c660111c84a72a6935eb8e30a7ae6\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_324c660111c84a72a6935eb8e30a7ae6\",\"kudu.table_id\":\"06447c1e53ac4366baae14ef41588d7f\",\"transient_lastDdlTime\":\"1786219209\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=27, eventTime=1786219212, eventType=CREATE_TABLE, dbName=default, tableName=table_42e6672ee7be4c4389fcc998d6eb322d, message={"server":"","servicePrincipal":"","db":"default","table":"table_42e6672ee7be4c4389fcc998d6eb322d","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_42e6672ee7be4c4389fcc998d6eb322d\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219212},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_42e6672ee7be4c4389fcc998d6eb322d\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_42e6672ee7be4c4389fcc998d6eb322d\",\"kudu.table_id\":\"67d34c9d2f51445e8cf367f41abbcc28\",\"transient_lastDdlTime\":\"1786219212\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=27, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_5730907850e643b4ac068a85e1574ddf, message={"server":"","servicePrincipal":"","db":"default","table":"table_5730907850e643b4ac068a85e1574ddf","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_5730907850e643b4ac068a85e1574ddf\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219212},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_5730907850e643b4ac068a85e1574ddf\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_5730907850e643b4ac068a85e1574ddf\",\"kudu.table_id\":\"bce1917a27c14330bfe2ccc5dc0b40a3\",\"transient_lastDdlTime\":\"1786219212\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7f95fb2c9d5d google::LogMessage::Fail() at ??:0
@ 0x7f95fb2cdb23 google::LogMessage::SendToLog() at ??:0
@ 0x7f95fb2c975c google::LogMessage::Flush() at ??:0
@ 0x7f95fb2c99a1 google::LogMessage::~LogMessage() at ??:0
I20260808 20:00:30.526134 25559 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2c4576401a74a60855647c956b195fd. Latest consensus state: current_term: 8 leader_uuid: "d2c4576401a74a60855647c956b195fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:30.526477 25559 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:30.531646 25554 mvcc.cc:204] Tried to move back new op lower bound from 7316353968165560320 to 7316353967736582144. Current Snapshot: MvccSnapshot[applied={T|T < 7316353968165560320}]
@ 0x7f9611f92f64 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f9611f91811 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7f9611f9948c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260808 20:00:30.548209 25423 catalog_manager.cc:6006] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Sending DeleteTablet for 3 replicas of tablet 55cf64ca16df4afbae5f58843f613f27
@ 0x7f9611f99309 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaaf86d std::function<>::operator()() at ??:?
I20260808 20:00:30.550587 25423 catalog_manager.cc:6807] ReplaceTablet: tablet 55cf64ca16df4afbae5f58843f613f27 deleted and replaced by tablet 17a8ac753f4b438ab59749ae0b4f4064
I20260808 20:00:30.553433 25559 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "d2c4576401a74a60855647c956b195fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:30.553669 25559 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:30.563769 22903 tablet_service.cc:1558] Processing DeleteTablet for tablet 55cf64ca16df4afbae5f58843f613f27 with delete_type TABLET_DATA_DELETED (replaced by tablet 17a8ac753f4b438ab59749ae0b4f4064) from {username='slave'} at 127.0.0.1:55318
@ 0x7f95fdff1dd9 kudu::Thread::SuperviseThread() at ??:0
I20260808 20:00:30.568662 25419 catalog_manager.cc:6006] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Sending DeleteTablet for 3 replicas of tablet 2523719318f84e31862e40d76f9a23f5
I20260808 20:00:30.569337 25419 catalog_manager.cc:6807] ReplaceTablet: tablet 2523719318f84e31862e40d76f9a23f5 deleted and replaced by tablet 5a619a059bc54777819c3b43148e9bcc
I20260808 20:00:30.569726 25425 catalog_manager.cc:6006] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Sending DeleteTablet for 3 replicas of tablet 27b71167912a4250a58941600e22488e
I20260808 20:00:30.570250 25425 catalog_manager.cc:6807] ReplaceTablet: tablet 27b71167912a4250a58941600e22488e deleted and replaced by tablet 6c09dc2a62be4ac585b214bc07fa6146
I20260808 20:00:30.570813 23136 tablet_service.cc:1558] Processing DeleteTablet for tablet 55cf64ca16df4afbae5f58843f613f27 with delete_type TABLET_DATA_DELETED (replaced by tablet 17a8ac753f4b438ab59749ae0b4f4064) from {username='slave'} at 127.0.0.1:35978
I20260808 20:00:30.571224 23138 tablet_service.cc:1558] Processing DeleteTablet for tablet 2523719318f84e31862e40d76f9a23f5 with delete_type TABLET_DATA_DELETED (replaced by tablet 5a619a059bc54777819c3b43148e9bcc) from {username='slave'} at 127.0.0.1:35978
I20260808 20:00:30.571503 23144 tablet_service.cc:1558] Processing DeleteTablet for tablet 27b71167912a4250a58941600e22488e with delete_type TABLET_DATA_DELETED (replaced by tablet 6c09dc2a62be4ac585b214bc07fa6146) from {username='slave'} at 127.0.0.1:35978
I20260808 20:00:30.572065 22905 tablet_service.cc:1558] Processing DeleteTablet for tablet 2523719318f84e31862e40d76f9a23f5 with delete_type TABLET_DATA_DELETED (replaced by tablet 5a619a059bc54777819c3b43148e9bcc) from {username='slave'} at 127.0.0.1:55318
I20260808 20:00:30.572350 22899 tablet_service.cc:1558] Processing DeleteTablet for tablet 27b71167912a4250a58941600e22488e with delete_type TABLET_DATA_DELETED (replaced by tablet 6c09dc2a62be4ac585b214bc07fa6146) from {username='slave'} at 127.0.0.1:55318
I20260808 20:00:30.573096 25598 tablet_replica.cc:333] T 55cf64ca16df4afbae5f58843f613f27 P 5f6b6c2e318d44a984120a06a09e9af9: stopping tablet replica
I20260808 20:00:30.573347 25598 raft_consensus.cc:2243] T 55cf64ca16df4afbae5f58843f613f27 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:30.573599 25598 raft_consensus.cc:2272] T 55cf64ca16df4afbae5f58843f613f27 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:30.575201 25425 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58424:
name: "default.Table_5730907850e643b4ac068a85e1574ddf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:30.575555 25426 catalog_manager.cc:6006] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd: Sending DeleteTablet for 3 replicas of tablet c75913753d95447783b9b7c7bb6ee701
I20260808 20:00:30.575778 25423 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58424:
name: "default.Table_bfc21652528345b883ecf7962d128fee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:30.576675 25595 tablet_replica.cc:333] T 55cf64ca16df4afbae5f58843f613f27 P e34d5caee97d44fa945a91ddc6a54653: stopping tablet replica
I20260808 20:00:30.576912 25595 raft_consensus.cc:2243] T 55cf64ca16df4afbae5f58843f613f27 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:30.577164 23136 tablet_service.cc:1558] Processing DeleteTablet for tablet c75913753d95447783b9b7c7bb6ee701 with delete_type TABLET_DATA_DELETED (replaced by tablet 07288087449a4dc8b8a3644b7e8ad54e) from {username='slave'} at 127.0.0.1:35978
I20260808 20:00:30.577191 25595 raft_consensus.cc:2272] T 55cf64ca16df4afbae5f58843f613f27 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:30.577322 25426 catalog_manager.cc:6807] ReplaceTablet: tablet c75913753d95447783b9b7c7bb6ee701 deleted and replaced by tablet 07288087449a4dc8b8a3644b7e8ad54e
I20260808 20:00:30.577200 25419 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58424:
name: "default.Table_aa0809b208774982934a9f8de43aecf5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:30.577713 25426 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58424:
table { table_name: "default.Table_530ab728450b4272b3e9573534afe4e6" } new_table_name: "default.Table_924eca5df51c4cceb65228505a337698" modify_external_catalogs: true
I20260808 20:00:30.577826 25595 ts_tablet_manager.cc:1916] T 55cf64ca16df4afbae5f58843f613f27 P e34d5caee97d44fa945a91ddc6a54653: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:30.578900 22903 tablet_service.cc:1558] Processing DeleteTablet for tablet c75913753d95447783b9b7c7bb6ee701 with delete_type TABLET_DATA_DELETED (replaced by tablet 07288087449a4dc8b8a3644b7e8ad54e) from {username='slave'} at 127.0.0.1:55318
I20260808 20:00:30.579125 25598 ts_tablet_manager.cc:1916] T 55cf64ca16df4afbae5f58843f613f27 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:30.580067 25544 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 8 leader_uuid: "d2c4576401a74a60855647c956b195fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:30.580515 25544 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2c4576401a74a60855647c956b195fd [sys.catalog]: This master's current role is: LEADER
I20260808 20:00:30.583113 25595 ts_tablet_manager.cc:1929] T 55cf64ca16df4afbae5f58843f613f27 P e34d5caee97d44fa945a91ddc6a54653: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260808 20:00:30.583226 25595 log.cc:1199] T 55cf64ca16df4afbae5f58843f613f27 P e34d5caee97d44fa945a91ddc6a54653: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/wal/wals/55cf64ca16df4afbae5f58843f613f27
I20260808 20:00:30.583658 25595 ts_tablet_manager.cc:1950] T 55cf64ca16df4afbae5f58843f613f27 P e34d5caee97d44fa945a91ddc6a54653: Deleting consensus metadata
@ 0x7f96016c16db start_thread at ??:0
I20260808 20:00:30.585127 25395 catalog_manager.cc:5050] TS e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): tablet 55cf64ca16df4afbae5f58843f613f27 (table default.table_530ab728450b4272b3e9573534afe4e6 [id=8c917809771f4262811b9f200ff0e925]) successfully deleted
I20260808 20:00:30.586541 25598 ts_tablet_manager.cc:1929] T 55cf64ca16df4afbae5f58843f613f27 P 5f6b6c2e318d44a984120a06a09e9af9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260808 20:00:30.586685 25598 log.cc:1199] T 55cf64ca16df4afbae5f58843f613f27 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/wal/wals/55cf64ca16df4afbae5f58843f613f27
@ 0x7f95fa17861f clone at ??:0
I20260808 20:00:30.587392 25595 tablet_replica.cc:333] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653: stopping tablet replica
I20260808 20:00:30.587674 25595 raft_consensus.cc:2243] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653 [term 1 LEADER]: Raft consensus shutting down.
I20260808 20:00:30.588068 25595 raft_consensus.cc:2272] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:30.588690 25595 ts_tablet_manager.cc:1916] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:30.587441 25598 ts_tablet_manager.cc:1950] T 55cf64ca16df4afbae5f58843f613f27 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting consensus metadata
I20260808 20:00:30.592985 25598 tablet_replica.cc:333] T 2523719318f84e31862e40d76f9a23f5 P 5f6b6c2e318d44a984120a06a09e9af9: stopping tablet replica
I20260808 20:00:30.593230 25598 raft_consensus.cc:2243] T 2523719318f84e31862e40d76f9a23f5 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:30.593436 25598 raft_consensus.cc:2272] T 2523719318f84e31862e40d76f9a23f5 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:30.594089 25598 ts_tablet_manager.cc:1916] T 2523719318f84e31862e40d76f9a23f5 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:30.595037 25595 ts_tablet_manager.cc:1929] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260808 20:00:30.595180 25595 log.cc:1199] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/wal/wals/2523719318f84e31862e40d76f9a23f5
I20260808 20:00:30.595631 25595 ts_tablet_manager.cc:1950] T 2523719318f84e31862e40d76f9a23f5 P e34d5caee97d44fa945a91ddc6a54653: Deleting consensus metadata
I20260808 20:00:30.596948 25595 tablet_replica.cc:333] T 27b71167912a4250a58941600e22488e P e34d5caee97d44fa945a91ddc6a54653: stopping tablet replica
I20260808 20:00:30.597146 25595 raft_consensus.cc:2243] T 27b71167912a4250a58941600e22488e P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:30.597425 25595 raft_consensus.cc:2272] T 27b71167912a4250a58941600e22488e P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:30.598109 25595 ts_tablet_manager.cc:1916] T 27b71167912a4250a58941600e22488e P e34d5caee97d44fa945a91ddc6a54653: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:30.601707 25598 ts_tablet_manager.cc:1929] T 2523719318f84e31862e40d76f9a23f5 P 5f6b6c2e318d44a984120a06a09e9af9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260808 20:00:30.601883 25598 log.cc:1199] T 2523719318f84e31862e40d76f9a23f5 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/wal/wals/2523719318f84e31862e40d76f9a23f5
I20260808 20:00:30.602362 25598 ts_tablet_manager.cc:1950] T 2523719318f84e31862e40d76f9a23f5 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting consensus metadata
I20260808 20:00:30.603523 25598 tablet_replica.cc:333] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9: stopping tablet replica
I20260808 20:00:30.603751 25598 raft_consensus.cc:2243] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 LEADER]: Raft consensus shutting down.
I20260808 20:00:30.604146 25598 raft_consensus.cc:2272] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:30.604785 25598 ts_tablet_manager.cc:1916] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:30.605288 25595 ts_tablet_manager.cc:1929] T 27b71167912a4250a58941600e22488e P e34d5caee97d44fa945a91ddc6a54653: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260808 20:00:30.605432 25595 log.cc:1199] T 27b71167912a4250a58941600e22488e P e34d5caee97d44fa945a91ddc6a54653: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/wal/wals/27b71167912a4250a58941600e22488e
I20260808 20:00:30.605875 25595 ts_tablet_manager.cc:1950] T 27b71167912a4250a58941600e22488e P e34d5caee97d44fa945a91ddc6a54653: Deleting consensus metadata
I20260808 20:00:30.607167 25595 tablet_replica.cc:333] T c75913753d95447783b9b7c7bb6ee701 P e34d5caee97d44fa945a91ddc6a54653: stopping tablet replica
I20260808 20:00:30.607409 25595 raft_consensus.cc:2243] T c75913753d95447783b9b7c7bb6ee701 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:30.607640 25595 raft_consensus.cc:2272] T c75913753d95447783b9b7c7bb6ee701 P e34d5caee97d44fa945a91ddc6a54653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:30.608273 25595 ts_tablet_manager.cc:1916] T c75913753d95447783b9b7c7bb6ee701 P e34d5caee97d44fa945a91ddc6a54653: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:30.611635 25598 ts_tablet_manager.cc:1929] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260808 20:00:30.611778 25598 log.cc:1199] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/wal/wals/27b71167912a4250a58941600e22488e
I20260808 20:00:30.612179 25598 ts_tablet_manager.cc:1950] T 27b71167912a4250a58941600e22488e P 5f6b6c2e318d44a984120a06a09e9af9: Deleting consensus metadata
I20260808 20:00:30.613261 25598 tablet_replica.cc:333] T c75913753d95447783b9b7c7bb6ee701 P 5f6b6c2e318d44a984120a06a09e9af9: stopping tablet replica
I20260808 20:00:30.613476 25598 raft_consensus.cc:2243] T c75913753d95447783b9b7c7bb6ee701 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 20:00:30.613651 25598 raft_consensus.cc:2272] T c75913753d95447783b9b7c7bb6ee701 P 5f6b6c2e318d44a984120a06a09e9af9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 20:00:30.614260 25598 ts_tablet_manager.cc:1916] T c75913753d95447783b9b7c7bb6ee701 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 20:00:30.615727 25595 ts_tablet_manager.cc:1929] T c75913753d95447783b9b7c7bb6ee701 P e34d5caee97d44fa945a91ddc6a54653: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260808 20:00:30.615916 25595 log.cc:1199] T c75913753d95447783b9b7c7bb6ee701 P e34d5caee97d44fa945a91ddc6a54653: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-1/wal/wals/c75913753d95447783b9b7c7bb6ee701
I20260808 20:00:30.616401 25595 ts_tablet_manager.cc:1950] T c75913753d95447783b9b7c7bb6ee701 P e34d5caee97d44fa945a91ddc6a54653: Deleting consensus metadata
I20260808 20:00:30.620954 25598 ts_tablet_manager.cc:1929] T c75913753d95447783b9b7c7bb6ee701 P 5f6b6c2e318d44a984120a06a09e9af9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260808 20:00:30.621165 25598 log.cc:1199] T c75913753d95447783b9b7c7bb6ee701 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting WAL directory at /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/ts-2/wal/wals/c75913753d95447783b9b7c7bb6ee701
I20260808 20:00:30.621592 25598 ts_tablet_manager.cc:1950] T c75913753d95447783b9b7c7bb6ee701 P 5f6b6c2e318d44a984120a06a09e9af9: Deleting consensus metadata
W20260808 20:00:30.788945 23071 connection.cc:573] server connection from 127.0.0.1:35978 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 20:00:30.788947 22831 connection.cc:573] server connection from 127.0.0.1:55318 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 20:00:30.789440 23072 connection.cc:573] client connection to 127.21.36.126:43945 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 20:00:30.789496 25580 negotiation.cc:336] Failed RPC negotiation. Trace:
0808 20:00:30.551654 (+ 0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:53332 (local address 127.21.36.65:39923)
0808 20:00:30.577641 (+ 25987us) server_negotiation.cc:207] Beginning negotiation
0808 20:00:30.577646 (+ 5us) server_negotiation.cc:400] Waiting for connection header
0808 20:00:30.577680 (+ 34us) server_negotiation.cc:408] Connection header received
0808 20:00:30.577763 (+ 83us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0808 20:00:30.577769 (+ 6us) server_negotiation.cc:462] Received NEGOTIATE request from client
0808 20:00:30.577852 (+ 83us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0808 20:00:30.578314 (+ 462us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
0808 20:00:30.587518 (+ 9204us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
0808 20:00:30.589044 (+ 1526us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
0808 20:00:30.789178 (+200134us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53332: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":25852,"thread_start_us":26291,"threads_started":1}
W20260808 20:00:30.790035 22607 connection.cc:573] client connection to 127.21.36.126:43945 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 20:00:30.790071 23276 connection.cc:573] client connection to 127.21.36.126:43945 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 20:00:30.790407 22835 connection.cc:573] client connection to 127.21.36.126:43945 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 20:00:30.790910 23276 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.21.36.126:43945)
W20260808 20:00:30.791551 23276 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.21.36.126:43945)
W20260808 20:00:30.791756 23276 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.21.36.126:43945)
W20260808 20:00:30.791931 23276 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.21.36.126:43945)
I20260808 20:00:31.029753 25559 raft_consensus.cc:493] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d2c4576401a74a60855647c956b195fd)
I20260808 20:00:31.029999 25559 raft_consensus.cc:515] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:31.030794 25559 leader_election.cc:290] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441)
W20260808 20:00:31.033476 25132 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:00:31.033710 25130 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441): Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
I20260808 20:00:31.033833 25130 leader_election.cc:304] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b91a1a84d6cd4038ac9d3ad2b8cf7979; no voters: 16a59d796024414abf9f82a7593530a6, d2c4576401a74a60855647c956b195fd
I20260808 20:00:31.034125 25559 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260808 20:00:31.116832 22607 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 1: this message will repeat every 5th retry.
W20260808 20:00:31.292908 22604 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 1: this message will repeat every 5th retry.
W20260808 20:00:31.299738 22604 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 1: this message will repeat every 5th retry.
W20260808 20:00:31.323859 22607 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 1: this message will repeat every 5th retry.
I20260808 20:00:31.412963 25092 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:00:31.413194 25092 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:00:31.636870 25634 raft_consensus.cc:493] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d2c4576401a74a60855647c956b195fd)
I20260808 20:00:31.637069 25634 raft_consensus.cc:515] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:31.637789 25634 leader_election.cc:290] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441)
W20260808 20:00:31.639577 25132 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:00:31.639756 25130 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441): Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
I20260808 20:00:31.639891 25130 leader_election.cc:304] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b91a1a84d6cd4038ac9d3ad2b8cf7979; no voters: 16a59d796024414abf9f82a7593530a6, d2c4576401a74a60855647c956b195fd
I20260808 20:00:31.640172 25634 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260808 20:00:31.937433 21649 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu pid 25092
I20260808 20:00:31.945606 25202 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 20:00:32.065661 21649 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu with pid 25092
W20260808 20:00:32.106377 25647 negotiation.cc:336] Failed RPC negotiation. Trace:
0808 20:00:32.104517 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.21.36.124:34593 (local address 127.21.36.65:37249)
0808 20:00:32.106068 (+ 1551us) negotiation.cc:107] Waiting for socket to connect
0808 20:00:32.106180 (+ 112us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":1436}
I20260808 20:00:33.010636 25679 raft_consensus.cc:493] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:00:33.010866 25679 raft_consensus.cc:515] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:33.011709 25679 leader_election.cc:290] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:00:33.012718 22604 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
W20260808 20:00:33.012904 22607 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
I20260808 20:00:33.013038 22607 leader_election.cc:304] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:00:33.013394 25679 raft_consensus.cc:2749] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:00:33.088444 21649 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu
/tmp/dist-test-taskNcG5N9/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.36.124:34593
--webserver_interface=127.21.36.124
--webserver_port=40825
--builtin_ntp_servers=127.21.36.84:34883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593
--hive_metastore_uris=thrift://127.0.0.1:44789
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260808 20:00:33.186053 25679 raft_consensus.cc:493] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:00:33.186278 25679 raft_consensus.cc:515] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:33.187036 25679 leader_election.cc:290] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:00:33.188115 22604 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
W20260808 20:00:33.188335 22607 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
I20260808 20:00:33.188503 22607 leader_election.cc:304] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:00:33.188831 25679 raft_consensus.cc:2749] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:00:33.231175 25677 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:00:33.231411 25677 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:33.232314 25677 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:00:33.233270 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:00:33.233491 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:00:33.233596 22607 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:00:33.233865 25677 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:00:33.474653 25681 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 20:00:33.475015 25681 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 20:00:33.475106 25681 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260808 20:00:33.484073 25681 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 20:00:33.484185 25681 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260808 20:00:33.484251 25681 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 20:00:33.484299 25681 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260808 20:00:33.495350 25681 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.36.84:34883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:44789
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.36.124:34593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.21.36.124
--webserver_port=40825
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 08 Aug 2026 19:43:23 UTC on bdcb31816ec0
build id 13246
ASAN enabled
I20260808 20:00:33.497422 25681 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 20:00:33.499346 25681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 20:00:33.508239 25700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 20:00:33.508285 25701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 20:00:33.509440 25705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 20:00:33.510066 25681 server_base.cc:1061] running on GCE node
I20260808 20:00:33.511029 25681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 20:00:33.512605 25681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 20:00:33.513814 25681 hybrid_clock.cc:648] HybridClock initialized: now 1786219233513769 us; error 38 us; skew 500 ppm
I20260808 20:00:33.514186 25681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 20:00:33.516525 25681 webserver.cc:533] Webserver started at http://127.21.36.124:40825/ using document root <none> and password file <none>
I20260808 20:00:33.517386 25681 fs_manager.cc:362] Metadata directory not provided
I20260808 20:00:33.517510 25681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 20:00:33.523536 25681 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 20:00:33.526935 25716 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 20:00:33.528606 25681 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 20:00:33.528770 25681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/data,/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/wal
uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979"
format_stamp: "Formatted at 2026-08-08 20:00:05 on dist-test-slave-pww0"
I20260808 20:00:33.529522 25681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 20:00:33.552531 25681 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 20:00:33.553678 25681 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 20:00:33.554008 25681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 20:00:33.579268 25681 rpc_server.cc:307] RPC server started. Bound to: 127.21.36.124:34593
I20260808 20:00:33.579268 25810 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.36.124:34593 every 8 connection(s)
I20260808 20:00:33.581892 25681 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-2/data/info.pb
I20260808 20:00:33.589073 21649 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu as pid 25681
I20260808 20:00:33.592932 25817 sys_catalog.cc:263] Verifying existing consensus state
I20260808 20:00:33.597836 23254 heartbeater.cc:344] Connected to a master server at 127.21.36.124:34593
I20260808 20:00:33.598848 25817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: Bootstrap starting.
I20260808 20:00:33.625284 25817 log.cc:826] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: Log is configured to *not* fsync() on all Append() calls
I20260808 20:00:33.659313 22791 heartbeater.cc:344] Connected to a master server at 127.21.36.124:34593
I20260808 20:00:33.664752 23016 heartbeater.cc:344] Connected to a master server at 127.21.36.124:34593
I20260808 20:00:33.713433 25817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: Bootstrap replayed 1/1 log segments. Stats: ops{read=108 overwritten=0 applied=108 ignored=0} inserts{seen=71 ignored=0} mutations{seen=86 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 20:00:33.714032 25817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: Bootstrap complete.
I20260808 20:00:33.719859 25817 raft_consensus.cc:359] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:33.720618 25817 raft_consensus.cc:740] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Becoming Follower/Learner. State: Replica: b91a1a84d6cd4038ac9d3ad2b8cf7979, State: Initialized, Role: FOLLOWER
I20260808 20:00:33.721330 25817 consensus_queue.cc:260] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 108, Last appended: 8.108, Last appended by leader: 108, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:33.722182 25827 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:33.722470 25827 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:33.723270 25817 sys_catalog.cc:565] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 20:00:33.751514 25850 catalog_manager.cc:1295] Loaded cluster ID: 9c4ad126d38943188e9e4422f5e27418
I20260808 20:00:33.751749 25850 catalog_manager.cc:1588] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: loading cluster ID for follower catalog manager: success
I20260808 20:00:33.755697 25850 catalog_manager.cc:1610] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: acquiring CA information for follower catalog manager: success
I20260808 20:00:33.752179 25681 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:00:33.758334 25681 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:00:33.758913 25850 catalog_manager.cc:1638] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 20:00:33.924448 25744 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" instance_seqno: 1786219207065397) as {username='slave'} at 127.21.36.65:38135; Asking this server to re-register.
I20260808 20:00:33.925316 22791 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:33.927839 25744 ts_manager.cc:194] Registered new tserver with Master: 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923)
I20260808 20:00:34.104509 25744 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" instance_seqno: 1786219208132788) as {username='slave'} at 127.21.36.67:41045; Asking this server to re-register.
I20260808 20:00:34.105378 23254 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:34.107373 25744 ts_manager.cc:194] Registered new tserver with Master: 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:34.168974 25745 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" instance_seqno: 1786219207598982) as {username='slave'} at 127.21.36.66:33317; Asking this server to re-register.
I20260808 20:00:34.169763 23016 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:34.171344 25745 ts_manager.cc:194] Registered new tserver with Master: e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
I20260808 20:00:34.299343 25861 raft_consensus.cc:493] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:34.299679 25861 raft_consensus.cc:515] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:34.301700 25861 leader_election.cc:290] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441)
W20260808 20:00:34.302721 25717 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
W20260808 20:00:34.304147 25720 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:00:34.304339 25717 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441): Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
I20260808 20:00:34.304504 25717 leader_election.cc:304] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b91a1a84d6cd4038ac9d3ad2b8cf7979; no voters: 16a59d796024414abf9f82a7593530a6, d2c4576401a74a60855647c956b195fd
I20260808 20:00:34.304903 25861 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260808 20:00:34.819900 25872 raft_consensus.cc:493] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:34.820087 25872 raft_consensus.cc:515] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:34.820849 25872 leader_election.cc:290] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441)
W20260808 20:00:34.823107 25717 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441): Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
W20260808 20:00:34.823307 25720 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
I20260808 20:00:34.823500 25720 leader_election.cc:304] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b91a1a84d6cd4038ac9d3ad2b8cf7979; no voters: 16a59d796024414abf9f82a7593530a6, d2c4576401a74a60855647c956b195fd
I20260808 20:00:34.823776 25872 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260808 20:00:34.898485 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 11: this message will repeat every 5th retry.
I20260808 20:00:35.683905 25885 raft_consensus.cc:493] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:35.684280 25885 raft_consensus.cc:515] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:35.685447 25885 leader_election.cc:290] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441)
W20260808 20:00:35.689311 25720 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:00:35.689703 25717 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441): Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
I20260808 20:00:35.689899 25717 leader_election.cc:304] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b91a1a84d6cd4038ac9d3ad2b8cf7979; no voters: 16a59d796024414abf9f82a7593530a6, d2c4576401a74a60855647c956b195fd
I20260808 20:00:35.690366 25885 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260808 20:00:35.768893 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 11: this message will repeat every 5th retry.
I20260808 20:00:36.425928 25899 raft_consensus.cc:493] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:36.426131 25899 raft_consensus.cc:515] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:36.427062 25899 leader_election.cc:290] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441)
W20260808 20:00:36.429225 25717 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441): Network error: Client connection negotiation failed: client connection to 127.21.36.125:36441: connect: Connection refused (error 111)
W20260808 20:00:36.429451 25720 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
I20260808 20:00:36.429574 25720 leader_election.cc:304] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b91a1a84d6cd4038ac9d3ad2b8cf7979; no voters: 16a59d796024414abf9f82a7593530a6, d2c4576401a74a60855647c956b195fd
I20260808 20:00:36.429875 25899 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260808 20:00:36.658098 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 11: this message will repeat every 5th retry.
I20260808 20:00:36.673640 21649 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu
/tmp/dist-test-taskNcG5N9/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.36.125:36441
--webserver_interface=127.21.36.125
--webserver_port=38063
--builtin_ntp_servers=127.21.36.84:34883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593
--hive_metastore_uris=thrift://127.0.0.1:44789
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260808 20:00:36.829957 25677 raft_consensus.cc:493] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:00:36.830188 25677 raft_consensus.cc:515] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:36.831175 25677 leader_election.cc:290] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:00:36.832355 22607 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
W20260808 20:00:36.832587 22604 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
I20260808 20:00:36.832746 22604 leader_election.cc:304] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:00:36.833069 25677 raft_consensus.cc:2749] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:00:37.056479 25908 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 20:00:37.056957 25908 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 20:00:37.057093 25908 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260808 20:00:37.066165 25908 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 20:00:37.066285 25908 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260808 20:00:37.066344 25908 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 20:00:37.066411 25908 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260808 20:00:37.077868 25908 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.36.84:34883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:44789
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.36.125:36441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.21.36.125
--webserver_port=38063
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 08 Aug 2026 19:43:23 UTC on bdcb31816ec0
build id 13246
ASAN enabled
I20260808 20:00:37.079911 25908 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 20:00:37.081941 25908 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 20:00:37.091248 25914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 20:00:37.092195 25915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 20:00:37.094117 25918 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 20:00:37.094849 25908 server_base.cc:1061] running on GCE node
I20260808 20:00:37.095829 25908 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 20:00:37.097594 25908 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 20:00:37.098847 25908 hybrid_clock.cc:648] HybridClock initialized: now 1786219237098803 us; error 44 us; skew 500 ppm
I20260808 20:00:37.099243 25908 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 20:00:37.101799 25908 webserver.cc:533] Webserver started at http://127.21.36.125:38063/ using document root <none> and password file <none>
I20260808 20:00:37.102600 25908 fs_manager.cc:362] Metadata directory not provided
I20260808 20:00:37.102721 25908 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 20:00:37.109009 25908 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 20:00:37.112524 25926 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 20:00:37.114221 25908 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 20:00:37.114398 25908 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/data,/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/wal
uuid: "16a59d796024414abf9f82a7593530a6"
format_stamp: "Formatted at 2026-08-08 20:00:05 on dist-test-slave-pww0"
I20260808 20:00:37.115228 25908 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 20:00:37.166922 25908 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 20:00:37.167958 25908 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 20:00:37.168247 25908 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 20:00:37.192174 25908 rpc_server.cc:307] RPC server started. Bound to: 127.21.36.125:36441
I20260808 20:00:37.192274 26018 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.36.125:36441 every 8 connection(s)
I20260808 20:00:37.194135 25908 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/master-1/data/info.pb
I20260808 20:00:37.195524 21649 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskNcG5N9/build/asan/bin/kudu as pid 25908
I20260808 20:00:37.218237 26020 sys_catalog.cc:263] Verifying existing consensus state
I20260808 20:00:37.224725 26020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6: Bootstrap starting.
I20260808 20:00:37.231693 22796 heartbeater.cc:344] Connected to a master server at 127.21.36.125:36441
I20260808 20:00:37.232118 23257 heartbeater.cc:344] Connected to a master server at 127.21.36.125:36441
I20260808 20:00:37.246376 26020 log.cc:826] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6: Log is configured to *not* fsync() on all Append() calls
I20260808 20:00:37.290561 25686 raft_consensus.cc:493] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:00:37.290779 25686 raft_consensus.cc:515] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:37.291656 25686 leader_election.cc:290] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:00:37.292881 22607 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
W20260808 20:00:37.293047 22604 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
I20260808 20:00:37.293169 22604 leader_election.cc:304] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:00:37.293663 25686 raft_consensus.cc:2749] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:00:37.324209 26020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=97 overwritten=0 applied=95 ignored=0} inserts{seen=62 ignored=0} mutations{seen=70 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260808 20:00:37.324930 26020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6: Bootstrap complete.
I20260808 20:00:37.330765 26020 raft_consensus.cc:359] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 5 FOLLOWER]: Replica starting. Triggering 2 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:37.334028 26020 raft_consensus.cc:740] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16a59d796024414abf9f82a7593530a6, State: Initialized, Role: FOLLOWER
I20260808 20:00:37.334996 26020 consensus_queue.cc:260] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 95, Last appended: 5.97, Last appended by leader: 97, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:37.335924 26032 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:37.336208 26032 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:37.337064 26020 sys_catalog.cc:565] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 20:00:37.351408 26052 catalog_manager.cc:1295] Loaded cluster ID: 9c4ad126d38943188e9e4422f5e27418
I20260808 20:00:37.351625 26052 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6: loading cluster ID for follower catalog manager: success
I20260808 20:00:37.351806 25686 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:00:37.351995 25686 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:37.352783 25686 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:00:37.354557 22604 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
W20260808 20:00:37.355417 22607 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:00:37.355598 22607 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:00:37.356153 25686 raft_consensus.cc:2749] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:00:37.357156 26052 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6: acquiring CA information for follower catalog manager: success
I20260808 20:00:37.348045 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:00:37.359512 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:00:37.360553 26052 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 20:00:37.396150 25957 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" instance_seqno: 1786219207065397) as {username='slave'} at 127.21.36.65:34939; Asking this server to re-register.
I20260808 20:00:37.397236 22796 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:37.399842 25957 ts_manager.cc:194] Registered new tserver with Master: 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923)
I20260808 20:00:37.445688 25957 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" instance_seqno: 1786219208132788) as {username='slave'} at 127.21.36.67:33145; Asking this server to re-register.
I20260808 20:00:37.446807 23257 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:37.449031 25957 ts_manager.cc:194] Registered new tserver with Master: 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
I20260808 20:00:37.672627 23019 heartbeater.cc:344] Connected to a master server at 127.21.36.125:36441
I20260808 20:00:37.676046 25957 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" instance_seqno: 1786219207598982) as {username='slave'} at 127.21.36.66:45135; Asking this server to re-register.
I20260808 20:00:37.677229 23019 heartbeater.cc:461] Registering TS with master...
I20260808 20:00:37.679258 25957 ts_manager.cc:194] Registered new tserver with Master: e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:00:37.834585 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 11: this message will repeat every 5th retry.
I20260808 20:00:37.846391 26066 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:37.846690 26066 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:37.848750 26066 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:00:37.849714 25934 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:00:37.851549 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
I20260808 20:00:37.856320 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "16a59d796024414abf9f82a7593530a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 97 } } ignore_live_leader: false dest_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" is_pre_election: true
I20260808 20:00:37.856861 25762 raft_consensus.cc:2368] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16a59d796024414abf9f82a7593530a6 for earlier term 6. Current term is 8.
I20260808 20:00:37.857930 25931 leader_election.cc:400] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 6 pre-election: Vote denied by peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593) with higher term. Message: Invalid argument: T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16a59d796024414abf9f82a7593530a6 for earlier term 6. Current term is 8.
I20260808 20:00:37.858026 25931 leader_election.cc:403] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260808 20:00:37.858366 26066 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 5 FOLLOWER]: Advancing to term 8
I20260808 20:00:37.862221 26066 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 8 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593) with higher term. Message: Invalid argument: T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16a59d796024414abf9f82a7593530a6 for earlier term 6. Current term is 8.
I20260808 20:00:38.335386 26077 raft_consensus.cc:493] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 20:00:38.335662 26077 raft_consensus.cc:515] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:38.336583 26077 leader_election.cc:290] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441)
W20260808 20:00:38.339227 25720 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
I20260808 20:00:38.344285 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" candidate_term: 9 candidate_status { last_received { term: 8 index: 108 } } ignore_live_leader: false dest_uuid: "16a59d796024414abf9f82a7593530a6" is_pre_election: true
I20260808 20:00:38.344815 25977 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b91a1a84d6cd4038ac9d3ad2b8cf7979 in term 8.
I20260808 20:00:38.345643 25717 leader_election.cc:304] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16a59d796024414abf9f82a7593530a6, b91a1a84d6cd4038ac9d3ad2b8cf7979; no voters: d2c4576401a74a60855647c956b195fd
I20260808 20:00:38.346053 26077 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260808 20:00:38.346181 26077 raft_consensus.cc:493] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 20:00:38.346288 26077 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 8 FOLLOWER]: Advancing to term 9
I20260808 20:00:38.350458 26077 raft_consensus.cc:515] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:38.351449 26077 leader_election.cc:290] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 election: Requested vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), 16a59d796024414abf9f82a7593530a6 (127.21.36.125:36441)
I20260808 20:00:38.352241 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" candidate_term: 9 candidate_status { last_received { term: 8 index: 108 } } ignore_live_leader: false dest_uuid: "16a59d796024414abf9f82a7593530a6"
I20260808 20:00:38.352501 25977 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 8 FOLLOWER]: Advancing to term 9
W20260808 20:00:38.353160 25720 leader_election.cc:336] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
I20260808 20:00:38.354982 25977 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b91a1a84d6cd4038ac9d3ad2b8cf7979 in term 9.
I20260808 20:00:38.355581 25717 leader_election.cc:304] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16a59d796024414abf9f82a7593530a6, b91a1a84d6cd4038ac9d3ad2b8cf7979; no voters: d2c4576401a74a60855647c956b195fd
I20260808 20:00:38.355921 26077 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 9 FOLLOWER]: Leader election won for term 9
I20260808 20:00:38.356326 26077 raft_consensus.cc:697] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [term 9 LEADER]: Becoming Leader. State: Replica: b91a1a84d6cd4038ac9d3ad2b8cf7979, State: Running, Role: LEADER
I20260808 20:00:38.357018 26077 consensus_queue.cc:237] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 108, Committed index: 108, Last appended: 8.108, Last appended by leader: 108, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:38.360472 26086 sys_catalog.cc:455] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b91a1a84d6cd4038ac9d3ad2b8cf7979. Latest consensus state: current_term: 9 leader_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:38.360693 26086 sys_catalog.cc:458] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [sys.catalog]: This master's current role is: LEADER
I20260808 20:00:38.361639 26092 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 20:00:38.364276 26092 catalog_manager.cc:679] Loaded metadata for table default.table_f7a6e8903ed74dc088eb1f490788c54b [id=0145ea517a7a4aec99304181d1c6cb28]
I20260808 20:00:38.364750 26092 catalog_manager.cc:679] Loaded metadata for table default.table_324c660111c84a72a6935eb8e30a7ae6 [id=06447c1e53ac4366baae14ef41588d7f]
I20260808 20:00:38.365113 26092 catalog_manager.cc:679] Loaded metadata for table default.table_61bf42c8286347d197162895f70520d7 [id=08230c16ec604c259195bbfa0c062164]
I20260808 20:00:38.365458 26092 catalog_manager.cc:679] Loaded metadata for table default.table_3ffa098d41af4ebb987cec463feb8e76 [id=1042ec7801c740c09255102bf01b8fd2]
I20260808 20:00:38.365792 26092 catalog_manager.cc:679] Loaded metadata for table default.table_4dc166b247ee4cf89cdd926e07b51a51 [id=355ea74a32ec4502b6679611e8c8b67e]
I20260808 20:00:38.366284 26092 catalog_manager.cc:679] Loaded metadata for table default.table_752d0310c94b42d3902fffa1070bb1d4 [id=3b10ed2d37fe46a5b63d646901474c8e]
I20260808 20:00:38.366624 26092 catalog_manager.cc:679] Loaded metadata for table default.table_4ed5029dcfbd499db24fb72e6b389d42 [id=43498092c52a457d93f97ba0993e6012]
I20260808 20:00:38.367034 26092 catalog_manager.cc:679] Loaded metadata for table default.table_732a1b16caff489aa844bba46e6ec1cb [id=524bfe483c7f4c4d99d2757ff290c5eb]
I20260808 20:00:38.367403 26092 catalog_manager.cc:679] Loaded metadata for table default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528]
I20260808 20:00:38.367820 26092 catalog_manager.cc:679] Loaded metadata for table default.table_42e6672ee7be4c4389fcc998d6eb322d [id=67d34c9d2f51445e8cf367f41abbcc28]
I20260808 20:00:38.368203 26092 catalog_manager.cc:679] Loaded metadata for table default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619]
I20260808 20:00:38.368526 26092 catalog_manager.cc:679] Loaded metadata for table default.table_1cd24efa52a547cc872dd7ffe4938fb8 [id=87fca666b411494c8486baf1bfa58327]
I20260808 20:00:38.368827 26092 catalog_manager.cc:679] Loaded metadata for table default.table_5a92fa3792a1443f94a707060264359c [id=89520ebff12347f18df06b25577ecf63]
I20260808 20:00:38.369123 26092 catalog_manager.cc:679] Loaded metadata for table default.table_530ab728450b4272b3e9573534afe4e6 [id=8c917809771f4262811b9f200ff0e925]
I20260808 20:00:38.369412 26092 catalog_manager.cc:679] Loaded metadata for table default.table_583f1fdac11148488799008b032f7ef2 [id=99b11a3c5ca3411b8c1800c70f61597a]
I20260808 20:00:38.369710 26092 catalog_manager.cc:679] Loaded metadata for table default.table_831d17f2742e4fb8bc727d56fc9d1c85 [id=b47087e2cd6349b1ba2b8daf55b2d1d5]
I20260808 20:00:38.369984 26092 catalog_manager.cc:679] Loaded metadata for table default.table_ba9e157aaf3a487eb4f3f2ec9c37b761 [id=edaf172891fe4dafbc1b00bbb27d9c1c]
I20260808 20:00:38.370306 26092 catalog_manager.cc:679] Loaded metadata for table default.table_01314a1f924d4e33bdecf8797a6e2e0a [id=fb4aaf09a463481d9f5512884b9574d7]
I20260808 20:00:38.372316 26092 tablet_loader.cc:96] loaded metadata for tablet 052275c6e1d34d9d9242718b4e803b48 (table default.table_f7a6e8903ed74dc088eb1f490788c54b [id=0145ea517a7a4aec99304181d1c6cb28])
I20260808 20:00:38.372627 26092 tablet_loader.cc:96] loaded metadata for tablet 07288087449a4dc8b8a3644b7e8ad54e (table default.table_752d0310c94b42d3902fffa1070bb1d4 [id=3b10ed2d37fe46a5b63d646901474c8e])
I20260808 20:00:38.373028 26092 tablet_loader.cc:96] loaded metadata for tablet 17a8ac753f4b438ab59749ae0b4f4064 (table default.table_530ab728450b4272b3e9573534afe4e6 [id=8c917809771f4262811b9f200ff0e925])
I20260808 20:00:38.373286 26092 tablet_loader.cc:96] loaded metadata for tablet 1f1032c7852540c9bda3a1c37cd4bc9f (table default.table_46d148afc6d142a0855d47f765b25297 [id=6ab57419bd7a4e3e97816482d3eab619])
I20260808 20:00:38.373513 26092 tablet_loader.cc:96] loaded metadata for tablet 2086c55bb74a4997bcc9a49205ecf0f5 (table default.table_01314a1f924d4e33bdecf8797a6e2e0a [id=fb4aaf09a463481d9f5512884b9574d7])
I20260808 20:00:38.374080 26092 tablet_loader.cc:96] loaded metadata for tablet 286e98ffe9b44ada92fd8e9776578df2 (table default.table_732a1b16caff489aa844bba46e6ec1cb [id=524bfe483c7f4c4d99d2757ff290c5eb])
I20260808 20:00:38.374475 26092 tablet_loader.cc:96] loaded metadata for tablet 308609a3a4504bb5902009fd82d0775b (table default.table_1cd24efa52a547cc872dd7ffe4938fb8 [id=87fca666b411494c8486baf1bfa58327])
I20260808 20:00:38.375185 26092 tablet_loader.cc:96] loaded metadata for tablet 5588a78091484cc2a3636e4e0f6d1c30 (table default.table_3ffa098d41af4ebb987cec463feb8e76 [id=1042ec7801c740c09255102bf01b8fd2])
I20260808 20:00:38.375666 26092 tablet_loader.cc:96] loaded metadata for tablet 55e7c93eae77489e9594c52cf22d4e45 (table default.table_c083bd43fffa4344b41de48e5edd3fd3 [id=53f52501c5e44774a011ce5d23f07528])
I20260808 20:00:38.375970 26092 tablet_loader.cc:96] loaded metadata for tablet 57c91cdb20e74754b418cbc9af674632 (table default.table_42e6672ee7be4c4389fcc998d6eb322d [id=67d34c9d2f51445e8cf367f41abbcc28])
I20260808 20:00:38.376175 26092 tablet_loader.cc:96] loaded metadata for tablet 5a619a059bc54777819c3b43148e9bcc (table default.table_5a92fa3792a1443f94a707060264359c [id=89520ebff12347f18df06b25577ecf63])
I20260808 20:00:38.376430 26092 tablet_loader.cc:96] loaded metadata for tablet 5d0d61aef7854aa49fe36f2f505207b7 (table default.table_4dc166b247ee4cf89cdd926e07b51a51 [id=355ea74a32ec4502b6679611e8c8b67e])
I20260808 20:00:38.376636 26092 tablet_loader.cc:96] loaded metadata for tablet 6c09dc2a62be4ac585b214bc07fa6146 (table default.table_583f1fdac11148488799008b032f7ef2 [id=99b11a3c5ca3411b8c1800c70f61597a])
I20260808 20:00:38.377801 26092 tablet_loader.cc:96] loaded metadata for tablet 9b63e4c056f34242aacef5ffafb14b25 (table default.table_ba9e157aaf3a487eb4f3f2ec9c37b761 [id=edaf172891fe4dafbc1b00bbb27d9c1c])
I20260808 20:00:38.378063 26092 tablet_loader.cc:96] loaded metadata for tablet a065666fbe014e339992f3d0e4cb18d2 (table default.table_61bf42c8286347d197162895f70520d7 [id=08230c16ec604c259195bbfa0c062164])
I20260808 20:00:38.378675 26092 tablet_loader.cc:96] loaded metadata for tablet b45729e2ec9e4a77b8be89f9657b0424 (table default.table_4ed5029dcfbd499db24fb72e6b389d42 [id=43498092c52a457d93f97ba0993e6012])
I20260808 20:00:38.378965 26092 tablet_loader.cc:96] loaded metadata for tablet b8948ef8ed844727b9fed1e91d9233f6 (table default.table_324c660111c84a72a6935eb8e30a7ae6 [id=06447c1e53ac4366baae14ef41588d7f])
I20260808 20:00:38.380123 26092 tablet_loader.cc:96] loaded metadata for tablet fabdfe3ddfa74b98a7cc870c4c8e9af6 (table default.table_831d17f2742e4fb8bc727d56fc9d1c85 [id=b47087e2cd6349b1ba2b8daf55b2d1d5])
I20260808 20:00:38.380415 26092 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 20:00:38.381615 26092 catalog_manager.cc:1295] Loaded cluster ID: 9c4ad126d38943188e9e4422f5e27418
I20260808 20:00:38.381698 26092 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 20:00:38.383155 26092 catalog_manager.cc:1540] Loading token signing keys...
I20260808 20:00:38.384331 26092 catalog_manager.cc:6103] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: Loaded TSK: 0
I20260808 20:00:38.385316 26092 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 20:00:38.386494 26092 catalog_manager.cc:1563] Loading latest processed Hive Metastore notification log event ID...
I20260808 20:00:38.387648 26092 catalog_manager.cc:5941] Last processed Hive Metastore notification event ID: 20
I20260808 20:00:38.486874 25745 master_service.cc:960] ReplaceTablet: received request to replace tablet 55e7c93eae77489e9594c52cf22d4e45 from {username='slave'} at 127.0.0.1:56540
I20260808 20:00:38.486985 25744 master_service.cc:960] ReplaceTablet: received request to replace tablet b8948ef8ed844727b9fed1e91d9233f6 from {username='slave'} at 127.0.0.1:56540
I20260808 20:00:38.489295 25734 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56540:
name: "default.Table_4390d242408442d790a0662898378018"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:38.490278 25729 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56540:
table { table_name: "default.Table_46d148afc6d142a0855d47f765b25297" } modify_external_catalogs: true
I20260808 20:00:38.490847 25729 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56540:
table { table_name: "default.Table_46d148afc6d142a0855d47f765b25297" } modify_external_catalogs: true
I20260808 20:00:38.491168 25735 master_service.cc:960] ReplaceTablet: received request to replace tablet 9b63e4c056f34242aacef5ffafb14b25 from {username='slave'} at 127.0.0.1:56540
I20260808 20:00:38.490792 25728 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56540:
name: "default.Table_b7b099db34ef495387d5650e289948e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 20:00:38.492340 25739 master_service.cc:960] ReplaceTablet: received request to replace tablet 5588a78091484cc2a3636e4e0f6d1c30 from {username='slave'} at 127.0.0.1:56540
I20260808 20:00:38.492290 25731 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56540:
table { table_name: "default.Table_324c660111c84a72a6935eb8e30a7ae6" } modify_external_catalogs: true
I20260808 20:00:38.492667 25731 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56540:
table { table_name: "default.Table_324c660111c84a72a6935eb8e30a7ae6" } modify_external_catalogs: true
I20260808 20:00:38.496320 25742 master_service.cc:960] ReplaceTablet: received request to replace tablet 286e98ffe9b44ada92fd8e9776578df2 from {username='slave'} at 127.0.0.1:56540
F20260808 20:00:38.497341 25848 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 27, previous 27; dumping first 8 out of 15 received events: NotificationEvent(eventId=21, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_831d17f2742e4fb8bc727d56fc9d1c85, message={"server":"","servicePrincipal":"","db":"default","table":"table_831d17f2742e4fb8bc727d56fc9d1c85","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_831d17f2742e4fb8bc727d56fc9d1c85\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219209},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_831d17f2742e4fb8bc727d56fc9d1c85\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_831d17f2742e4fb8bc727d56fc9d1c85\",\"kudu.table_id\":\"b47087e2cd6349b1ba2b8daf55b2d1d5\",\"transient_lastDdlTime\":\"1786219209\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=22, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_752d0310c94b42d3902fffa1070bb1d4, message={"server":"","servicePrincipal":"","db":"default","table":"table_752d0310c94b42d3902fffa1070bb1d4","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_752d0310c94b42d3902fffa1070bb1d4\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219209},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_752d0310c94b42d3902fffa1070bb1d4\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_752d0310c94b42d3902fffa1070bb1d4\",\"kudu.table_id\":\"3b10ed2d37fe46a5b63d646901474c8e\",\"transient_lastDdlTime\":\"1786219209\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1786219212, eventType=CREATE_TABLE, dbName=default, tableName=table_aa0809b208774982934a9f8de43aecf5, message={"server":"","servicePrincipal":"","db":"default","table":"table_aa0809b208774982934a9f8de43aecf5","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_aa0809b208774982934a9f8de43aecf5\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219212},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_aa0809b208774982934a9f8de43aecf5\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_aa0809b208774982934a9f8de43aecf5\",\"kudu.table_id\":\"1ba38449531f437d8795f5e35a3f9479\",\"transient_lastDdlTime\":\"1786219212\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=24, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_4dc166b247ee4cf89cdd926e07b51a51, message={"server":"","servicePrincipal":"","db":"default","table":"table_4dc166b247ee4cf89cdd926e07b51a51","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_4dc166b247ee4cf89cdd926e07b51a51\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219210},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_4dc166b247ee4cf89cdd926e07b51a51\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_4dc166b247ee4cf89cdd926e07b51a51\",\"kudu.table_id\":\"355ea74a32ec4502b6679611e8c8b67e\",\"transient_lastDdlTime\":\"1786219210\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=25, eventTime=1786219212, eventType=CREATE_TABLE, dbName=default, tableName=table_bfc21652528345b883ecf7962d128fee, message={"server":"","servicePrincipal":"","db":"default","table":"table_bfc21652528345b883ecf7962d128fee","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_bfc21652528345b883ecf7962d128fee\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219212},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_bfc21652528345b883ecf7962d128fee\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_bfc21652528345b883ecf7962d128fee\",\"kudu.table_id\":\"95d1dc4138bd491da51e09440dab7eee\",\"transient_lastDdlTime\":\"1786219212\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=26, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_324c660111c84a72a6935eb8e30a7ae6, message={"server":"","servicePrincipal":"","db":"default","table":"table_324c660111c84a72a6935eb8e30a7ae6","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_324c660111c84a72a6935eb8e30a7ae6\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219209},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_324c660111c84a72a6935eb8e30a7ae6\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_324c660111c84a72a6935eb8e30a7ae6\",\"kudu.table_id\":\"06447c1e53ac4366baae14ef41588d7f\",\"transient_lastDdlTime\":\"1786219209\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=27, eventTime=1786219212, eventType=CREATE_TABLE, dbName=default, tableName=table_42e6672ee7be4c4389fcc998d6eb322d, message={"server":"","servicePrincipal":"","db":"default","table":"table_42e6672ee7be4c4389fcc998d6eb322d","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_42e6672ee7be4c4389fcc998d6eb322d\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219212},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_42e6672ee7be4c4389fcc998d6eb322d\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_42e6672ee7be4c4389fcc998d6eb322d\",\"kudu.table_id\":\"67d34c9d2f51445e8cf367f41abbcc28\",\"transient_lastDdlTime\":\"1786219212\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=27, eventTime=1786219212, eventType=DROP_TABLE, dbName=default, tableName=table_5730907850e643b4ac068a85e1574ddf, message={"server":"","servicePrincipal":"","db":"default","table":"table_5730907850e643b4ac068a85e1574ddf","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_5730907850e643b4ac068a85e1574ddf\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786219212},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskNcG5N9/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786219187936521-21649-0/minicluster-data/warehouse/table_5730907850e643b4ac068a85e1574ddf\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_5730907850e643b4ac068a85e1574ddf\",\"kudu.table_id\":\"bce1917a27c14330bfe2ccc5dc0b40a3\",\"transient_lastDdlTime\":\"1786219212\",\"comment\":\"\",\"kudu.master_addresses\":\"127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"9c4ad126d38943188e9e4422f5e27418\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786219212}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
I20260808 20:00:38.498742 25733 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56540:
table { table_name: "default.Table_4ed5029dcfbd499db24fb72e6b389d42" } new_table_name: "default.Table_a9d94ade99394dc6b742a534c91da3bd" modify_external_catalogs: true
@ 0x7f76ae2cbd5d google::LogMessage::Fail() at ??:0
I20260808 20:00:38.502656 25977 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Refusing update from remote peer b91a1a84d6cd4038ac9d3ad2b8cf7979: Log matching property violated. Preceding OpId in replica: term: 5 index: 97. Preceding OpId from leader: term: 9 index: 110. (index mismatch)
I20260808 20:00:38.503688 26086 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 109, Last known committed idx: 95, Time since last communication: 0.000s
@ 0x7f76ae2cfb23 google::LogMessage::SendToLog() at ??:0
@ 0x7f76ae2cb75c google::LogMessage::Flush() at ??:0
@ 0x7f76ae2cb9a1 google::LogMessage::~LogMessage() at ??:0
W20260808 20:00:38.514061 25720 consensus_peers.cc:597] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979 -> Peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Couldn't send request to peer d2c4576401a74a60855647c956b195fd. Status: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
@ 0x7f76c4f94f64 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f76c4f93811 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7f76c4f9b48c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7f76c4f9b309 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaaf86d std::function<>::operator()() at ??:?
I20260808 20:00:38.542901 26114 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 9 leader_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:38.543262 26114 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:38.543890 26098 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b91a1a84d6cd4038ac9d3ad2b8cf7979. Latest consensus state: current_term: 9 leader_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:38.544165 26098 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:38.545634 26108 mvcc.cc:204] Tried to move back new op lower bound from 7316353968193159168 to 7316353922860265472. Current Snapshot: MvccSnapshot[applied={T|T < 7316353968193159168 or (T in {7316353968193159168})}]
I20260808 20:00:38.546085 26095 mvcc.cc:204] Tried to move back new op lower bound from 7316354000896020480 to 7316354000315453440. Current Snapshot: MvccSnapshot[applied={T|T < 7316354000896020480}]
@ 0x7f76b0ff3dd9 kudu::Thread::SuperviseThread() at ??:0
I20260808 20:00:38.548593 25744 catalog_manager.cc:6006] T 00000000000000000000000000000000 P b91a1a84d6cd4038ac9d3ad2b8cf7979: Sending DeleteTablet for 3 replicas of tablet b8948ef8ed844727b9fed1e91d9233f6
@ 0x7f76b46c36db start_thread at ??:0
I20260808 20:00:38.550057 26121 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 9 leader_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:38.550380 26121 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:38.550849 25744 catalog_manager.cc:6807] ReplaceTablet: tablet b8948ef8ed844727b9fed1e91d9233f6 deleted and replaced by tablet f6960410b1654cbf93f4839f7ef058e0
@ 0x7f76ad17a61f clone at ??:0
I20260808 20:00:38.554144 26121 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 9 leader_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:38.554366 26121 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 20:00:38.554248 26118 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 9 leader_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } } }
I20260808 20:00:38.554596 26118 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 20:00:38.740751 25936 connection.cc:573] server connection from 127.0.0.1:47852 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 20:00:38.741433 22832 connection.cc:573] client connection to 127.21.36.124:34593 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 20:00:38.741911 23274 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.21.36.124:34593)
W20260808 20:00:38.742214 23274 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.21.36.124:34593)
W20260808 20:00:38.742427 23274 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.21.36.124:34593)
W20260808 20:00:38.743149 23274 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.21.36.124:34593)
W20260808 20:00:38.742621 26132 negotiation.cc:336] Failed RPC negotiation. Trace:
0808 20:00:38.551661 (+ 0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:41968 (local address 127.21.36.67:43047)
0808 20:00:38.552161 (+ 500us) server_negotiation.cc:207] Beginning negotiation
0808 20:00:38.552168 (+ 7us) server_negotiation.cc:400] Waiting for connection header
0808 20:00:38.742255 (+190087us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41968: BlockingRecv error: recv got EOF from 127.0.0.1:41968 (error 108)
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":262,"threads_started":1}
I20260808 20:00:39.052676 26118 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:00:39.052932 26118 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:39.053790 26118 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:00:39.056173 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:00:39.056445 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:00:39.056653 25931 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:00:39.056989 26118 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260808 20:00:39.579092 21649 master-stress-test.cc:579] Killing test thread 1/25
I20260808 20:00:39.710206 26166 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:00:39.710434 26166 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:39.711179 26166 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:00:39.713438 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:00:39.713654 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:00:39.713775 25931 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:00:39.714039 26166 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260808 20:00:40.294866 26173 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:00:40.295073 26173 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:40.295818 26173 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:00:40.297968 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:00:40.298175 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:00:40.298300 25931 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:00:40.298576 26173 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260808 20:00:40.784900 22604 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 6: this message will repeat every 5th retry.
W20260808 20:00:40.817693 22607 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 6: this message will repeat every 5th retry.
I20260808 20:00:41.211383 26194 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:00:41.211669 26194 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:41.212359 26194 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:00:41.215555 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:00:41.215786 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:00:41.215920 25931 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:00:41.216214 26194 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260808 20:00:41.399966 22607 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 6: this message will repeat every 5th retry.
W20260808 20:00:41.543412 22604 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 6: this message will repeat every 5th retry.
I20260808 20:00:41.830000 26184 raft_consensus.cc:493] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:00:41.830222 26184 raft_consensus.cc:515] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:41.831182 26184 leader_election.cc:290] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:00:41.832401 22604 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
W20260808 20:00:41.832605 22607 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
I20260808 20:00:41.832784 22607 leader_election.cc:304] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:00:41.833101 26184 raft_consensus.cc:2749] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:00:42.361392 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:00:42.361632 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:00:42.665128 26219 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:00:42.665359 26219 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:42.666131 26219 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:00:42.668110 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
I20260808 20:00:42.703292 26184 raft_consensus.cc:493] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:00:42.703545 26184 raft_consensus.cc:515] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:42.704342 26184 leader_election.cc:290] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:00:42.705370 22604 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
W20260808 20:00:42.705564 22607 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
I20260808 20:00:42.705754 22607 leader_election.cc:304] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:00:42.706054 26184 raft_consensus.cc:2749] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:00:43.676000 25931 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20260808 20:00:43.677812 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:00:43.678022 25931 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:00:43.678579 26236 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260808 20:00:43.760741 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 16: this message will repeat every 5th retry.
W20260808 20:00:45.345046 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 16: this message will repeat every 5th retry.
W20260808 20:00:45.819448 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 16: this message will repeat every 5th retry.
I20260808 20:00:46.480225 26248 raft_consensus.cc:493] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:00:46.480461 26248 raft_consensus.cc:515] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:46.481387 26248 leader_election.cc:290] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:00:46.482374 22604 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
W20260808 20:00:46.482829 22607 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
I20260808 20:00:46.482954 22607 leader_election.cc:304] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:00:46.483253 26248 raft_consensus.cc:2749] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:00:46.567938 26266 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:00:46.568199 26266 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:46.569010 26266 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:00:46.571431 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:00:46.571686 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:00:46.571841 25931 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:00:46.572116 26266 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260808 20:00:46.937249 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 16: this message will repeat every 5th retry.
I20260808 20:00:47.102519 26248 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:00:47.102823 26248 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:47.103580 26248 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:00:47.104604 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:00:47.104822 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:00:47.104934 22607 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:00:47.105216 26248 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:00:47.173023 26248 raft_consensus.cc:493] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:00:47.173251 26248 raft_consensus.cc:515] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:00:47.173924 26248 leader_election.cc:290] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:00:47.175009 22607 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
W20260808 20:00:47.175210 22604 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
I20260808 20:00:47.175347 22604 leader_election.cc:304] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:00:47.175619 26248 raft_consensus.cc:2749] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:00:47.363300 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:00:47.363572 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:00:47.764272 26293 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:00:47.764485 26293 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:47.765343 26293 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:00:47.767377 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:00:47.767624 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:00:47.767786 25931 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:00:47.768052 26293 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260808 20:00:49.369410 26324 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:00:49.369625 26324 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:49.370390 26324 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:00:49.371331 25934 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111) [suppressed 4 similar messages]
W20260808 20:00:49.372653 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:00:49.372839 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
I20260808 20:00:49.372961 25934 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:00:49.373272 26324 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260808 20:00:50.227583 22607 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 11: this message will repeat every 5th retry.
W20260808 20:00:50.790351 22604 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 11: this message will repeat every 5th retry.
W20260808 20:00:51.012248 22607 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 11: this message will repeat every 5th retry.
W20260808 20:00:51.634584 22604 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 11: this message will repeat every 5th retry.
I20260808 20:00:52.365142 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:00:52.365350 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:00:53.110682 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 21: this message will repeat every 5th retry.
I20260808 20:00:55.309285 26248 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:00:55.309499 26248 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:55.310317 26248 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:00:55.311388 22604 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
W20260808 20:00:55.311662 22607 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:00:55.311826 22607 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:00:55.312124 26248 raft_consensus.cc:2749] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:00:55.377440 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 21: this message will repeat every 5th retry.
I20260808 20:00:55.897265 26248 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:00:55.897495 26248 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:55.898237 26248 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:00:55.899220 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:00:55.899430 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:00:55.899602 22607 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:00:55.899875 26248 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:00:56.335961 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 21: this message will repeat every 5th retry.
W20260808 20:00:56.611212 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 21: this message will repeat every 5th retry.
I20260808 20:00:57.366833 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:00:57.367026 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:00:58.305465 26248 raft_consensus.cc:493] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:00:58.305680 26248 raft_consensus.cc:515] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:00:58.306596 26248 leader_election.cc:290] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:00:58.307775 22607 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
W20260808 20:00:58.307986 22604 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
I20260808 20:00:58.308166 22604 leader_election.cc:304] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:00:58.308493 26248 raft_consensus.cc:2749] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:00:58.628928 26436 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:00:58.629145 26436 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:00:58.630010 26436 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:00:58.631031 25934 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260808 20:00:58.632648 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:00:58.632844 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:00:58.632961 25931 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:00:58.633222 26436 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260808 20:00:59.314229 26248 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:00:59.314453 26248 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:00:59.315136 26248 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:00:59.316341 22607 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
W20260808 20:00:59.316551 22604 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:00:59.316718 22604 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:00:59.317013 26248 raft_consensus.cc:2749] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:00:59.736639 22607 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 16: this message will repeat every 5th retry.
W20260808 20:01:00.423135 22607 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 16: this message will repeat every 5th retry.
W20260808 20:01:00.470867 22604 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 16: this message will repeat every 5th retry.
W20260808 20:01:01.193626 22604 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 16: this message will repeat every 5th retry.
I20260808 20:01:01.435642 25677 raft_consensus.cc:493] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:01:01.435892 25677 raft_consensus.cc:515] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:01:01.436590 25677 leader_election.cc:290] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:01:01.437835 22604 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
W20260808 20:01:01.438078 22607 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
I20260808 20:01:01.438230 22607 leader_election.cc:304] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:01:01.438540 25677 raft_consensus.cc:2749] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:01:02.368806 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:01:02.369030 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:01:02.497665 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 26: this message will repeat every 5th retry.
I20260808 20:01:02.527410 26248 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:01:02.527660 26248 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:01:02.528379 26248 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:01:02.529563 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:01:02.529749 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:01:02.529938 22607 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:01:02.530244 26248 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:01:03.242939 26495 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:01:03.243139 26495 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:01:03.244026 26495 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:01:03.246376 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:01:03.246575 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:01:03.246685 25931 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:01:03.246928 26495 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260808 20:01:04.547984 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 26: this message will repeat every 5th retry.
I20260808 20:01:04.789850 25677 raft_consensus.cc:493] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:01:04.790098 25677 raft_consensus.cc:515] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:01:04.790896 25677 leader_election.cc:290] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:01:04.792037 22604 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
W20260808 20:01:04.792223 22607 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
I20260808 20:01:04.792340 22607 leader_election.cc:304] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:01:04.792613 25677 raft_consensus.cc:2749] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:01:05.829020 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 26: this message will repeat every 5th retry.
W20260808 20:01:06.469998 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 26: this message will repeat every 5th retry.
I20260808 20:01:07.370745 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:01:07.370987 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:01:08.688205 22794 heartbeater.cc:646] Failed to heartbeat to 127.21.36.126:43945 (232 consecutive failures): Network error: Failed to ping master at 127.21.36.126:43945: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:01:08.824954 23016 heartbeater.cc:646] Failed to heartbeat to 127.21.36.124:34593 (60 consecutive failures): Network error: Failed to ping master at 127.21.36.124:34593: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:01:08.877516 23254 heartbeater.cc:646] Failed to heartbeat to 127.21.36.124:34593 (89 consecutive failures): Network error: Failed to ping master at 127.21.36.124:34593: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:01:10.247648 22607 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 21: this message will repeat every 5th retry.
W20260808 20:01:10.447826 22604 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 21: this message will repeat every 5th retry.
W20260808 20:01:10.705997 22607 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 21: this message will repeat every 5th retry.
I20260808 20:01:11.047184 26555 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:01:11.047413 26555 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:01:11.048157 26555 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:01:11.049211 22607 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
W20260808 20:01:11.049389 22604 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:01:11.049535 22604 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:01:11.049827 26555 raft_consensus.cc:2749] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:01:11.287875 22604 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 21: this message will repeat every 5th retry.
W20260808 20:01:11.918576 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 31: this message will repeat every 5th retry.
I20260808 20:01:12.372759 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:01:12.372996 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:01:13.505121 26595 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:01:13.505349 26595 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:01:13.506188 26595 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:01:13.507352 25934 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260808 20:01:13.508621 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:01:13.508793 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
I20260808 20:01:13.508925 25934 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:01:13.509199 26595 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260808 20:01:14.411870 25679 raft_consensus.cc:493] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:01:14.412081 25679 raft_consensus.cc:515] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:01:14.413074 25679 leader_election.cc:290] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:01:14.413921 22604 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
W20260808 20:01:14.414105 22607 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
I20260808 20:01:14.414237 22607 leader_election.cc:304] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:01:14.414494 25679 raft_consensus.cc:2749] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:01:14.749795 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 31: this message will repeat every 5th retry.
W20260808 20:01:15.521201 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 31: this message will repeat every 5th retry.
I20260808 20:01:17.374588 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:01:17.374864 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:01:17.566788 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 31: this message will repeat every 5th retry.
I20260808 20:01:18.220173 25679 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:01:18.220388 25679 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:01:18.221127 25679 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:01:18.222270 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:01:18.222469 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:01:18.222644 22604 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:01:18.222919 25679 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:01:19.510527 22607 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 26: this message will repeat every 5th retry.
W20260808 20:01:20.127830 22604 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 26: this message will repeat every 5th retry.
I20260808 20:01:20.141903 26555 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:01:20.142122 26555 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:01:20.142894 26555 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:01:20.143931 22607 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
W20260808 20:01:20.144125 22604 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:01:20.144255 22604 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:01:20.144537 26555 raft_consensus.cc:2749] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:01:20.428166 26555 raft_consensus.cc:493] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:01:20.428381 26555 raft_consensus.cc:515] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:01:20.429113 26555 leader_election.cc:290] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:01:20.430116 22604 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
W20260808 20:01:20.430347 22607 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
I20260808 20:01:20.430454 22607 leader_election.cc:304] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:01:20.430763 26555 raft_consensus.cc:2749] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:01:20.505728 22607 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 26: this message will repeat every 5th retry.
W20260808 20:01:20.819169 22604 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 26: this message will repeat every 5th retry.
W20260808 20:01:21.443061 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 36: this message will repeat every 5th retry.
I20260808 20:01:21.686757 26555 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:01:21.686973 26555 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:01:21.687740 26555 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:01:21.688819 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:01:21.689038 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:01:21.689172 22604 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:01:21.689472 26555 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:01:22.376540 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:01:22.376775 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:01:22.566780 26555 raft_consensus.cc:493] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:01:22.566993 26555 raft_consensus.cc:515] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:01:22.567791 26555 leader_election.cc:290] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:01:22.568990 22607 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
W20260808 20:01:22.569217 22604 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
I20260808 20:01:22.569326 22604 leader_election.cc:304] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:01:22.569590 26555 raft_consensus.cc:2749] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:01:25.037609 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 36: this message will repeat every 5th retry.
W20260808 20:01:25.603108 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 36: this message will repeat every 5th retry.
I20260808 20:01:27.228271 26740 raft_consensus.cc:493] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:01:27.228492 26740 raft_consensus.cc:515] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:01:27.229295 26740 leader_election.cc:290] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:01:27.230400 22604 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
W20260808 20:01:27.230613 22607 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
I20260808 20:01:27.230728 22607 leader_election.cc:304] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:01:27.230983 26740 raft_consensus.cc:2749] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:01:27.378448 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:01:27.378659 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:01:27.875214 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 36: this message will repeat every 5th retry.
W20260808 20:01:28.938623 22607 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 31: this message will repeat every 5th retry.
I20260808 20:01:30.696030 26824 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:01:30.696362 26824 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:01:30.697494 26824 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:01:30.698647 25934 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260808 20:01:30.699983 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:01:30.700213 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:01:30.700347 25931 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:01:30.700654 26824 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260808 20:01:30.759500 22604 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 31: this message will repeat every 5th retry.
W20260808 20:01:30.774430 22604 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 31: this message will repeat every 5th retry.
W20260808 20:01:31.186242 22607 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 31: this message will repeat every 5th retry.
I20260808 20:01:31.207255 26741 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:01:31.207518 26741 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:01:31.208456 26741 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:01:31.209621 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:01:31.209817 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:01:31.209928 22604 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:01:31.210194 26741 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:01:31.517060 26741 raft_consensus.cc:493] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:01:31.517290 26741 raft_consensus.cc:515] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:01:31.517989 26741 leader_election.cc:290] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:01:31.519143 22607 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
W20260808 20:01:31.519382 22604 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
I20260808 20:01:31.519590 22604 leader_election.cc:304] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:01:31.519896 26741 raft_consensus.cc:2749] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:01:31.686657 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 41: this message will repeat every 5th retry.
I20260808 20:01:32.380340 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:01:32.380683 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:01:33.831651 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 41: this message will repeat every 5th retry.
I20260808 20:01:33.983307 26740 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:01:33.983565 26740 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:01:33.984239 26740 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:01:33.985160 22607 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
W20260808 20:01:33.985380 22604 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:01:33.985584 22604 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:01:33.985919 26740 raft_consensus.cc:2749] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:01:35.803238 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 41: this message will repeat every 5th retry.
W20260808 20:01:37.214100 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 41: this message will repeat every 5th retry.
I20260808 20:01:37.382542 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:01:37.382794 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:01:39.507175 26874 raft_consensus.cc:493] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:01:39.507414 26874 raft_consensus.cc:515] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:01:39.508396 26874 leader_election.cc:290] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:01:39.509539 22604 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
W20260808 20:01:39.509814 22607 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
I20260808 20:01:39.509949 22607 leader_election.cc:304] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:01:39.510288 26874 raft_consensus.cc:2749] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:01:39.763940 22607 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 36: this message will repeat every 5th retry.
I20260808 20:01:39.940572 26953 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:01:39.940894 26953 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:01:39.941699 26953 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:01:39.942700 25934 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260808 20:01:39.944029 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:01:39.944202 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
I20260808 20:01:39.944360 25934 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:01:39.944675 26953 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260808 20:01:40.344888 22604 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 36: this message will repeat every 5th retry.
W20260808 20:01:40.422029 22604 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 36: this message will repeat every 5th retry.
I20260808 20:01:40.917378 26875 raft_consensus.cc:493] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:01:40.917670 26875 raft_consensus.cc:515] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:01:40.918515 26875 leader_election.cc:290] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:01:40.919654 22607 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
W20260808 20:01:40.919902 22604 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
I20260808 20:01:40.920020 22604 leader_election.cc:304] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:01:40.920343 26875 raft_consensus.cc:2749] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:01:41.098928 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 46: this message will repeat every 5th retry.
W20260808 20:01:41.725204 22607 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 36: this message will repeat every 5th retry.
I20260808 20:01:42.384696 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:01:42.384938 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:01:44.770180 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 46: this message will repeat every 5th retry.
W20260808 20:01:45.177659 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 46: this message will repeat every 5th retry.
I20260808 20:01:47.003965 26875 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:01:47.004292 26875 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:01:47.005554 26875 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:01:47.006415 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:01:47.006752 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:01:47.006950 22607 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:01:47.007295 26875 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:01:47.040052 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 46: this message will repeat every 5th retry.
I20260808 20:01:47.388028 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:01:47.388409 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:01:47.842917 26875 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:01:47.843248 26875 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:01:47.844209 26875 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:01:47.845340 22607 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
W20260808 20:01:47.845651 22604 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:01:47.845862 22604 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:01:47.846154 26875 raft_consensus.cc:2749] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:01:48.395350 26875 raft_consensus.cc:493] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:01:48.395692 26875 raft_consensus.cc:515] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:01:48.396661 26875 leader_election.cc:290] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:01:48.397722 22604 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
W20260808 20:01:48.397926 22607 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
I20260808 20:01:48.398138 22607 leader_election.cc:304] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:01:48.398474 26875 raft_consensus.cc:2749] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:01:49.333014 27067 raft_consensus.cc:493] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:01:49.333324 27067 raft_consensus.cc:515] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:01:49.334499 27067 leader_election.cc:290] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:01:49.335448 22604 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
W20260808 20:01:49.335666 22607 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
I20260808 20:01:49.335942 22607 leader_election.cc:304] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:01:49.336436 27067 raft_consensus.cc:2749] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:01:49.601295 22607 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 41: this message will repeat every 5th retry.
W20260808 20:01:50.136833 22604 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 41: this message will repeat every 5th retry.
W20260808 20:01:50.465245 22604 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 41: this message will repeat every 5th retry.
W20260808 20:01:50.924305 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 51: this message will repeat every 5th retry.
I20260808 20:01:52.390085 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:01:52.390352 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:01:52.462744 22607 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 41: this message will repeat every 5th retry.
I20260808 20:01:54.180270 27145 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:01:54.180632 27145 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:01:54.181960 27145 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:01:54.184054 25934 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260808 20:01:54.186317 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:01:54.186618 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
I20260808 20:01:54.186820 25934 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:01:54.187215 27145 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260808 20:01:55.167179 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 51: this message will repeat every 5th retry.
W20260808 20:01:55.467777 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 51: this message will repeat every 5th retry.
I20260808 20:01:55.914947 27160 raft_consensus.cc:493] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:01:55.915256 27160 raft_consensus.cc:515] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:01:55.916175 27160 leader_election.cc:290] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:01:55.917102 22604 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
W20260808 20:01:55.917315 22607 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
I20260808 20:01:55.917455 22607 leader_election.cc:304] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:01:55.917850 27160 raft_consensus.cc:2749] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:01:57.392653 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:01:57.393003 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:01:57.443539 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 51: this message will repeat every 5th retry.
W20260808 20:02:00.131987 22604 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 46: this message will repeat every 5th retry.
W20260808 20:02:00.298699 22604 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 46: this message will repeat every 5th retry.
W20260808 20:02:00.431722 22607 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 46: this message will repeat every 5th retry.
W20260808 20:02:00.557435 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 56: this message will repeat every 5th retry.
I20260808 20:02:00.725080 27059 raft_consensus.cc:493] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:02:00.725332 27059 raft_consensus.cc:515] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:02:00.726230 27059 leader_election.cc:290] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:02:00.727272 22607 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
W20260808 20:02:00.727546 22604 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
I20260808 20:02:00.727667 22604 leader_election.cc:304] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:02:00.727954 27059 raft_consensus.cc:2749] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:02:01.972215 22607 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 46: this message will repeat every 5th retry.
I20260808 20:02:02.296046 26999 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:02:02.296267 26999 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:02:02.297227 26999 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:02:02.298486 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:02:02.298731 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:02:02.298874 22604 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:02:02.299175 26999 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:02:02.394565 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:02:02.394814 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:02:03.185392 27160 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:02:03.185727 27160 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:02:03.186817 27160 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:02:03.187716 22607 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
W20260808 20:02:03.188104 22604 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:02:03.188334 22604 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:02:03.188771 27160 raft_consensus.cc:2749] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:02:04.702965 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 56: this message will repeat every 5th retry.
W20260808 20:02:05.313838 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 56: this message will repeat every 5th retry.
I20260808 20:02:07.397137 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:02:07.397529 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:02:07.543356 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 56: this message will repeat every 5th retry.
W20260808 20:02:08.979713 22791 heartbeater.cc:646] Failed to heartbeat to 127.21.36.124:34593 (549 consecutive failures): Network error: Failed to ping master at 127.21.36.124:34593: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:02:08.994015 23016 heartbeater.cc:646] Failed to heartbeat to 127.21.36.124:34593 (180 consecutive failures): Network error: Failed to ping master at 127.21.36.124:34593: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:02:09.076407 23256 heartbeater.cc:646] Failed to heartbeat to 127.21.36.126:43945 (296 consecutive failures): Network error: Failed to ping master at 127.21.36.126:43945: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
I20260808 20:02:09.341825 27387 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:02:09.342171 27387 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:02:09.344007 27387 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:02:09.346450 25934 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260808 20:02:09.349498 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:02:09.349841 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:02:09.350234 25931 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:02:09.350677 27387 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260808 20:02:10.351138 22607 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 51: this message will repeat every 5th retry.
I20260808 20:02:10.794337 27407 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:02:10.794716 27407 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:02:10.796080 27407 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:02:10.797462 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:02:10.797714 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:02:10.797994 22604 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:02:10.798329 27407 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:02:10.880831 22604 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 51: this message will repeat every 5th retry.
W20260808 20:02:10.991099 22607 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 51: this message will repeat every 5th retry.
W20260808 20:02:11.288324 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 61: this message will repeat every 5th retry.
I20260808 20:02:11.603263 27407 raft_consensus.cc:493] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:02:11.603608 27407 raft_consensus.cc:515] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:02:11.604755 27407 leader_election.cc:290] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:02:11.605805 22604 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
W20260808 20:02:11.606091 22607 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
I20260808 20:02:11.606266 22607 leader_election.cc:304] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:02:11.606616 27407 raft_consensus.cc:2749] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:02:11.715543 22604 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 51: this message will repeat every 5th retry.
I20260808 20:02:12.399569 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:02:12.399824 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:02:14.500294 27380 raft_consensus.cc:493] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:02:14.500603 27380 raft_consensus.cc:515] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:02:14.501528 27380 leader_election.cc:290] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:02:14.502518 22604 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
W20260808 20:02:14.502817 22607 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
I20260808 20:02:14.503005 22607 leader_election.cc:304] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:02:14.503494 27380 raft_consensus.cc:2749] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:02:14.840183 27406 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:02:14.840493 27406 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:02:14.841566 27406 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:02:14.842386 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:02:14.842762 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:02:14.842944 22607 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:02:14.843308 27406 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:02:14.927574 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 61: this message will repeat every 5th retry.
W20260808 20:02:15.632120 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 61: this message will repeat every 5th retry.
I20260808 20:02:17.402297 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:02:17.402631 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:02:18.587123 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 61: this message will repeat every 5th retry.
I20260808 20:02:18.587193 27406 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:02:18.587427 27406 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:02:18.588927 27406 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:02:18.589799 22607 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
W20260808 20:02:18.590039 22604 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:02:18.590202 22604 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:02:18.590586 27406 raft_consensus.cc:2749] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:02:19.264086 27533 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:02:19.264328 27533 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:02:19.265219 27533 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:02:19.267270 25931 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:02:19.267345 25934 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260808 20:02:19.269695 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:02:19.269975 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
I20260808 20:02:19.270253 25934 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:02:19.270660 27533 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260808 20:02:20.002848 27551 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:02:20.003208 27551 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:02:20.004105 27551 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:02:20.005379 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:02:20.005667 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:02:20.005955 22604 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:02:20.006418 27551 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:02:20.065773 22607 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 56: this message will repeat every 5th retry.
W20260808 20:02:21.228070 22607 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 56: this message will repeat every 5th retry.
W20260808 20:02:21.264977 22604 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 56: this message will repeat every 5th retry.
W20260808 20:02:21.734412 22604 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 56: this message will repeat every 5th retry.
W20260808 20:02:21.877662 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 66: this message will repeat every 5th retry.
I20260808 20:02:22.405318 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:02:22.405654 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:02:25.190407 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 66: this message will repeat every 5th retry.
W20260808 20:02:25.509150 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 66: this message will repeat every 5th retry.
I20260808 20:02:26.347131 27623 raft_consensus.cc:493] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:02:26.347353 27623 raft_consensus.cc:515] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:02:26.348191 27623 leader_election.cc:290] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:02:26.349423 22607 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
W20260808 20:02:26.349747 22604 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
I20260808 20:02:26.350060 22604 leader_election.cc:304] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:02:26.350528 27623 raft_consensus.cc:2749] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:02:26.767853 27646 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:02:26.768268 27646 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:02:26.769810 27646 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:02:26.771662 25934 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:02:26.774029 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:02:26.774593 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:02:26.774849 25931 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:02:26.775230 27646 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260808 20:02:27.407961 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:02:27.408289 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:02:28.869999 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 66: this message will repeat every 5th retry.
W20260808 20:02:30.362865 22607 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 61: this message will repeat every 5th retry.
W20260808 20:02:30.694339 22607 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 61: this message will repeat every 5th retry.
W20260808 20:02:30.868788 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 71: this message will repeat every 5th retry.
W20260808 20:02:31.282724 22604 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 61: this message will repeat every 5th retry.
I20260808 20:02:31.964923 27623 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:02:31.965261 27623 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:02:31.966372 27623 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:02:31.967736 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:02:31.967990 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:02:31.968307 22607 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:02:31.968791 27623 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:02:32.021795 22604 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 61: this message will repeat every 5th retry.
I20260808 20:02:32.412772 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:02:32.413147 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:02:32.503098 27623 raft_consensus.cc:493] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:02:32.503394 27623 raft_consensus.cc:515] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:02:32.504534 27623 leader_election.cc:290] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:02:32.505553 22604 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
W20260808 20:02:32.505820 22607 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
I20260808 20:02:32.506081 22607 leader_election.cc:304] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:02:32.506476 27623 raft_consensus.cc:2749] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:02:34.360927 27623 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:02:34.361147 27623 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:02:34.362540 27623 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:02:34.363806 22607 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
W20260808 20:02:34.364215 22604 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:02:34.364430 22604 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:02:34.364815 27623 raft_consensus.cc:2749] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:02:35.251889 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 71: this message will repeat every 5th retry.
W20260808 20:02:35.411180 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 71: this message will repeat every 5th retry.
I20260808 20:02:37.358137 25939 maintenance_manager.cc:419] P 16a59d796024414abf9f82a7593530a6: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033339
I20260808 20:02:37.416167 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:02:37.416543 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:02:37.431133 25938 maintenance_manager.cc:643] P 16a59d796024414abf9f82a7593530a6: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.072s user 0.030s sys 0.012s Metrics: {"bytes_written":24002,"cfile_init":1,"dirs.queue_time_us":1079,"dirs.run_cpu_time_us":255,"dirs.run_wall_time_us":2858,"drs_written":1,"lbm_read_time_us":78,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1072,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":67,"thread_start_us":1191,"threads_started":2,"wal-append.queue_time_us":653}
I20260808 20:02:37.432780 25939 maintenance_manager.cc:419] P 16a59d796024414abf9f82a7593530a6: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 4235 bytes on disk
I20260808 20:02:37.433694 25938 maintenance_manager.cc:643] P 16a59d796024414abf9f82a7593530a6: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":80,"lbm_reads_lt_1ms":4}
I20260808 20:02:37.901285 27774 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:02:37.901728 27774 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:02:37.903560 27774 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:02:37.904299 25934 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260808 20:02:37.907681 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:02:37.908030 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:02:37.908344 25931 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:02:37.908732 27774 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260808 20:02:38.433862 27785 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:02:38.434154 27785 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:02:38.435324 27785 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:02:38.438380 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:02:38.438699 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
I20260808 20:02:38.438999 25934 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:02:38.439378 27785 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260808 20:02:38.664433 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 71: this message will repeat every 5th retry.
W20260808 20:02:40.619575 22607 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 66: this message will repeat every 5th retry.
W20260808 20:02:40.943279 22604 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 66: this message will repeat every 5th retry.
W20260808 20:02:41.149121 22607 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 66: this message will repeat every 5th retry.
W20260808 20:02:41.315840 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 76: this message will repeat every 5th retry.
I20260808 20:02:41.750214 27830 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:02:41.750592 27830 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:02:41.752015 27830 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:02:41.756567 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:02:41.756964 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:02:41.757172 25931 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:02:41.757665 27830 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260808 20:02:42.108232 27769 raft_consensus.cc:493] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:02:42.108564 27769 raft_consensus.cc:515] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:02:42.109869 27769 leader_election.cc:290] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:02:42.110903 22607 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
W20260808 20:02:42.111289 22604 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
I20260808 20:02:42.111517 22604 leader_election.cc:304] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:02:42.112077 27769 raft_consensus.cc:2749] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:02:42.418844 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:02:42.419126 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:02:42.514853 22604 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 66: this message will repeat every 5th retry.
W20260808 20:02:44.963315 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 76: this message will repeat every 5th retry.
W20260808 20:02:45.446113 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 76: this message will repeat every 5th retry.
I20260808 20:02:45.528649 27919 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:02:45.528934 27919 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:02:45.530333 27919 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:02:45.531729 25934 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20260808 20:02:45.534099 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:02:45.534457 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
I20260808 20:02:45.534747 25934 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:02:45.535105 27919 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260808 20:02:45.710727 27911 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:02:45.710947 27911 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:02:45.711755 27911 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:02:45.712960 22604 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
W20260808 20:02:45.713119 22607 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:02:45.713209 22607 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:02:45.713442 27911 raft_consensus.cc:2749] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:02:47.421356 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:02:47.421646 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:02:47.899755 27893 raft_consensus.cc:493] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:02:47.899937 27893 raft_consensus.cc:515] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:02:47.900640 27893 leader_election.cc:290] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:02:47.901516 22607 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
W20260808 20:02:47.901665 22604 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
I20260808 20:02:47.901787 22604 leader_election.cc:304] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:02:47.902012 27893 raft_consensus.cc:2749] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:02:48.469909 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 76: this message will repeat every 5th retry.
I20260808 20:02:49.913362 27999 raft_consensus.cc:493] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:02:49.913595 27999 raft_consensus.cc:515] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:02:49.914716 27999 leader_election.cc:290] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:02:49.916112 22607 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
W20260808 20:02:49.916277 22604 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
I20260808 20:02:49.916371 22604 leader_election.cc:304] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:02:49.916595 27999 raft_consensus.cc:2749] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:02:50.585477 22607 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 71: this message will repeat every 5th retry.
W20260808 20:02:50.640543 22607 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 71: this message will repeat every 5th retry.
W20260808 20:02:51.081810 22604 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 71: this message will repeat every 5th retry.
I20260808 20:02:51.536943 28027 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:02:51.537137 28027 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:02:51.537825 28027 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:02:51.538831 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:02:51.538980 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:02:51.539095 22607 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:02:51.539340 28027 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:02:51.962309 22604 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 71: this message will repeat every 5th retry.
W20260808 20:02:52.004091 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 81: this message will repeat every 5th retry.
I20260808 20:02:52.423823 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:02:52.424042 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:02:55.055279 27911 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:02:55.055516 27911 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:02:55.056313 27911 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:02:55.057471 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:02:55.057631 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:02:55.057756 22607 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:02:55.058015 27911 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:02:55.263196 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 81: this message will repeat every 5th retry.
W20260808 20:02:55.372349 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 81: this message will repeat every 5th retry.
I20260808 20:02:57.426584 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:02:57.426947 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:02:58.176596 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 81: this message will repeat every 5th retry.
W20260808 20:03:00.074277 22607 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 76: this message will repeat every 5th retry.
I20260808 20:03:00.168190 27911 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:03:00.168409 27911 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:03:00.169212 27911 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:03:00.170322 22604 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
W20260808 20:03:00.170493 22607 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:03:00.170634 22607 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:03:00.170903 27911 raft_consensus.cc:2749] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:03:00.293018 22607 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 76: this message will repeat every 5th retry.
W20260808 20:03:00.788348 22604 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 76: this message will repeat every 5th retry.
W20260808 20:03:01.776700 22604 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 76: this message will repeat every 5th retry.
W20260808 20:03:02.237973 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 86: this message will repeat every 5th retry.
I20260808 20:03:02.429829 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:03:02.430187 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:03:03.381350 28027 raft_consensus.cc:493] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:03:03.381556 28027 raft_consensus.cc:515] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:03:03.382263 28027 leader_election.cc:290] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:03:03.383497 22607 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
W20260808 20:03:03.383692 22604 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
I20260808 20:03:03.383817 22604 leader_election.cc:304] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:03:03.384162 28027 raft_consensus.cc:2749] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:03:04.373811 28307 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:03:04.374037 28307 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:03:04.375034 28307 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:03:04.376340 25934 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260808 20:03:04.377926 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:03:04.378219 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:03:04.378420 25931 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:03:04.378741 28307 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260808 20:03:05.130210 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 86: this message will repeat every 5th retry.
I20260808 20:03:05.261246 27911 raft_consensus.cc:493] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:03:05.261441 27911 raft_consensus.cc:515] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:03:05.262499 27911 leader_election.cc:290] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:03:05.263753 22604 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
W20260808 20:03:05.263995 22607 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
I20260808 20:03:05.264170 22607 leader_election.cc:304] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:03:05.264420 27911 raft_consensus.cc:2749] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:03:05.833581 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 86: this message will repeat every 5th retry.
I20260808 20:03:06.417459 28352 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:03:06.417845 28352 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:03:06.418751 28352 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:03:06.421605 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:03:06.421823 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:03:06.422072 25931 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:03:06.422474 28352 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260808 20:03:07.432715 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:03:07.433070 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:03:08.012522 27911 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:03:08.012751 27911 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:03:08.013456 27911 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:03:08.014668 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:03:08.014876 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:03:08.015005 22607 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:03:08.015269 27911 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:03:08.075260 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 86: this message will repeat every 5th retry.
W20260808 20:03:09.178854 23016 heartbeater.cc:646] Failed to heartbeat to 127.21.36.124:34593 (300 consecutive failures): Network error: Failed to ping master at 127.21.36.124:34593: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:03:09.318421 22794 heartbeater.cc:646] Failed to heartbeat to 127.21.36.126:43945 (966 consecutive failures): Network error: Failed to ping master at 127.21.36.126:43945: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:03:09.522357 23256 heartbeater.cc:646] Failed to heartbeat to 127.21.36.126:43945 (476 consecutive failures): Network error: Failed to ping master at 127.21.36.126:43945: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:03:09.522831 22607 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 81: this message will repeat every 5th retry.
W20260808 20:03:10.135753 22607 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 81: this message will repeat every 5th retry.
I20260808 20:03:10.501742 27911 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:03:10.501925 27911 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:03:10.502599 27911 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:03:10.503747 22604 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
W20260808 20:03:10.503901 22607 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:03:10.504026 22607 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:03:10.504276 27911 raft_consensus.cc:2749] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:03:10.864108 22604 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 81: this message will repeat every 5th retry.
W20260808 20:03:11.411191 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 91: this message will repeat every 5th retry.
W20260808 20:03:11.930012 22604 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 81: this message will repeat every 5th retry.
I20260808 20:03:12.434909 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:03:12.435118 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:03:14.336262 28447 raft_consensus.cc:493] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:03:14.336449 28447 raft_consensus.cc:515] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:03:14.337118 28447 leader_election.cc:290] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:03:14.338174 22604 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
W20260808 20:03:14.338376 22607 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
I20260808 20:03:14.338505 22607 leader_election.cc:304] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:03:14.338748 28447 raft_consensus.cc:2749] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:03:14.794697 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 91: this message will repeat every 5th retry.
W20260808 20:03:15.968710 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 91: this message will repeat every 5th retry.
I20260808 20:03:16.992606 28531 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:03:16.993053 28531 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:03:16.994464 28531 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:03:16.996721 25934 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260808 20:03:16.999109 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:03:16.999563 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
I20260808 20:03:16.999929 25934 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:03:17.000334 28531 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260808 20:03:17.436512 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:03:17.436781 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:03:18.017983 28447 raft_consensus.cc:493] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:03:18.018214 28447 raft_consensus.cc:515] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:03:18.018874 28447 leader_election.cc:290] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:03:18.020035 22604 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
W20260808 20:03:18.020205 22607 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
I20260808 20:03:18.020311 22607 leader_election.cc:304] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:03:18.020598 28447 raft_consensus.cc:2749] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:03:18.279263 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 91: this message will repeat every 5th retry.
I20260808 20:03:18.672224 28567 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:03:18.672432 28567 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:03:18.673156 28567 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:03:18.676574 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:03:18.676815 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:03:18.676942 25931 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:03:18.677232 28567 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260808 20:03:19.354583 22607 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 86: this message will repeat every 5th retry.
W20260808 20:03:20.369388 22607 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 86: this message will repeat every 5th retry.
W20260808 20:03:21.191916 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 96: this message will repeat every 5th retry.
W20260808 20:03:21.328118 22604 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 86: this message will repeat every 5th retry.
I20260808 20:03:21.648351 28447 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:03:21.648594 28447 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:03:21.649507 28447 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:03:21.650759 22604 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
W20260808 20:03:21.650969 22607 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:03:21.651103 22607 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:03:21.651387 28447 raft_consensus.cc:2749] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:03:21.768250 22604 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 86: this message will repeat every 5th retry.
I20260808 20:03:22.439381 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:03:22.439663 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:03:23.858825 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 96: this message will repeat every 5th retry.
I20260808 20:03:25.814472 28027 raft_consensus.cc:493] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:03:25.814694 28027 raft_consensus.cc:515] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:03:25.815631 28027 leader_election.cc:290] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:03:25.816846 22607 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
W20260808 20:03:25.817042 22604 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
I20260808 20:03:25.817157 22604 leader_election.cc:304] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:03:25.817416 28027 raft_consensus.cc:2749] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:03:26.831106 28027 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:03:26.831303 28027 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:03:26.832073 28027 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:03:26.833417 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:03:26.833809 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:03:26.833956 22607 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:03:26.834308 28027 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:03:27.056375 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 96: this message will repeat every 5th retry.
I20260808 20:03:27.442245 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:03:27.442741 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:03:27.692574 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 96: this message will repeat every 5th retry.
I20260808 20:03:28.887950 28785 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:03:28.888442 28785 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:03:28.890002 28785 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:03:28.892263 25934 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:03:28.892385 25931 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260808 20:03:28.894655 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:03:28.894923 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:03:28.895221 25931 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:03:28.895658 28785 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260808 20:03:29.196399 22607 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 91: this message will repeat every 5th retry.
W20260808 20:03:29.437266 22607 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 91: this message will repeat every 5th retry.
I20260808 20:03:30.452720 28764 raft_consensus.cc:493] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:03:30.452896 28764 raft_consensus.cc:515] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:03:30.453552 28764 leader_election.cc:290] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:03:30.454557 22604 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
W20260808 20:03:30.454743 22607 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
I20260808 20:03:30.454864 22607 leader_election.cc:304] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:03:30.455188 28764 raft_consensus.cc:2749] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:03:30.711416 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 101: this message will repeat every 5th retry.
W20260808 20:03:31.121677 22604 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 91: this message will repeat every 5th retry.
W20260808 20:03:31.539714 22604 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 91: this message will repeat every 5th retry.
I20260808 20:03:32.445188 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:03:32.445567 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:03:32.516868 28764 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:03:32.517127 28764 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:03:32.517997 28764 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:03:32.518743 22607 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
W20260808 20:03:32.519115 22604 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:03:32.519212 22604 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:03:32.519438 28764 raft_consensus.cc:2749] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:03:34.650038 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 101: this message will repeat every 5th retry.
I20260808 20:03:36.430423 28879 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:03:36.430621 28879 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:03:36.431327 28879 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:03:36.432521 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:03:36.432715 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:03:36.432830 22607 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:03:36.433089 28879 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:03:37.447077 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:03:37.447290 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:03:37.481158 28925 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:03:37.481390 28925 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:03:37.482298 28925 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:03:37.483485 22607 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
W20260808 20:03:37.483732 22604 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:03:37.483861 22604 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:03:37.484153 28925 raft_consensus.cc:2749] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:03:37.736984 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 101: this message will repeat every 5th retry.
W20260808 20:03:38.594614 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 101: this message will repeat every 5th retry.
W20260808 20:03:39.128791 22607 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 96: this message will repeat every 5th retry.
W20260808 20:03:39.399106 22607 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 96: this message will repeat every 5th retry.
W20260808 20:03:39.752144 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 106: this message will repeat every 5th retry.
W20260808 20:03:40.771129 22604 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 96: this message will repeat every 5th retry.
W20260808 20:03:41.816051 22604 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 96: this message will repeat every 5th retry.
I20260808 20:03:42.240459 29020 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:03:42.240653 29020 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:03:42.241377 29020 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:03:42.242309 22607 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
W20260808 20:03:42.242501 22604 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:03:42.242584 22604 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:03:42.242810 29017 raft_consensus.cc:2749] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:03:42.449920 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:03:42.450281 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:03:42.464931 29017 raft_consensus.cc:493] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:03:42.465214 29017 raft_consensus.cc:515] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:03:42.466140 29017 leader_election.cc:290] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:03:42.467113 22604 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
W20260808 20:03:42.467259 22607 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
I20260808 20:03:42.467391 22607 leader_election.cc:304] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:03:42.467671 29017 raft_consensus.cc:2749] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:03:43.081565 29052 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:03:43.082041 29052 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
W20260808 20:03:43.085093 25934 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
I20260808 20:03:43.085950 29052 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:03:43.088141 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:03:43.088428 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:03:43.088685 25931 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:03:43.089309 29052 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260808 20:03:43.675335 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 106: this message will repeat every 5th retry.
I20260808 20:03:46.598778 29116 raft_consensus.cc:493] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:03:46.598996 29116 raft_consensus.cc:515] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:03:46.599761 29116 leader_election.cc:290] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:03:46.600658 22607 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
W20260808 20:03:46.600828 22604 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
I20260808 20:03:46.600965 22604 leader_election.cc:304] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:03:46.601297 29116 raft_consensus.cc:2749] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:03:47.060276 29137 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:03:47.060603 29137 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:03:47.061689 29137 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:03:47.062826 22607 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
W20260808 20:03:47.063087 22604 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:03:47.063306 22604 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:03:47.063761 29137 raft_consensus.cc:2749] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:03:47.452071 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:03:47.452313 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:03:47.876636 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 106: this message will repeat every 5th retry.
W20260808 20:03:47.959244 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 106: this message will repeat every 5th retry.
W20260808 20:03:48.552110 22607 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 101: this message will repeat every 5th retry.
W20260808 20:03:49.336895 22607 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 101: this message will repeat every 5th retry.
W20260808 20:03:49.778535 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 111: this message will repeat every 5th retry.
W20260808 20:03:51.190830 22604 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 101: this message will repeat every 5th retry.
W20260808 20:03:51.466995 22604 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 101: this message will repeat every 5th retry.
I20260808 20:03:51.558920 29243 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:03:51.559155 29243 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:03:51.560074 29243 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:03:51.561529 25934 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260808 20:03:51.563071 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:03:51.563294 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:03:51.563446 25931 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:03:51.563819 29243 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260808 20:03:52.148455 29173 raft_consensus.cc:493] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:03:52.148639 29173 raft_consensus.cc:515] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:03:52.149284 29173 leader_election.cc:290] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:03:52.150305 22604 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
W20260808 20:03:52.150477 22607 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
I20260808 20:03:52.150602 22607 leader_election.cc:304] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:03:52.150849 29173 raft_consensus.cc:2749] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:03:52.454121 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:03:52.454355 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:03:53.450423 29303 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:03:53.450716 29303 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:03:53.451658 29303 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:03:53.454365 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:03:53.454632 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:03:53.454913 25931 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:03:53.455282 29303 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260808 20:03:53.841230 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 111: this message will repeat every 5th retry.
I20260808 20:03:53.993996 29173 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:03:53.994234 29173 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:03:53.995105 29173 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:03:53.995908 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:03:53.996270 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:03:53.996372 22607 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:03:53.996665 29173 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:03:57.457000 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:03:57.457257 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:03:57.501273 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 111: this message will repeat every 5th retry.
W20260808 20:03:57.720271 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 111: this message will repeat every 5th retry.
I20260808 20:03:58.288210 29408 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:03:58.288453 29408 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:03:58.289311 29408 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:03:58.290561 25931 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260808 20:03:58.292080 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:03:58.292276 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
I20260808 20:03:58.292428 25934 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:03:58.292729 29408 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260808 20:03:58.800731 22607 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 106: this message will repeat every 5th retry.
I20260808 20:03:59.553295 29383 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:03:59.553580 29383 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:03:59.554450 29383 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:03:59.555572 22607 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
W20260808 20:03:59.555733 22604 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:03:59.555881 22604 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:03:59.556111 29383 raft_consensus.cc:2749] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:03:59.921558 22607 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 106: this message will repeat every 5th retry.
W20260808 20:04:00.095422 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 116: this message will repeat every 5th retry.
W20260808 20:04:00.998993 22604 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 106: this message will repeat every 5th retry.
W20260808 20:04:01.909869 22604 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 106: this message will repeat every 5th retry.
I20260808 20:04:02.459582 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:04:02.459910 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:04:03.748579 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 116: this message will repeat every 5th retry.
I20260808 20:04:05.487533 29480 raft_consensus.cc:493] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:04:05.487742 29480 raft_consensus.cc:515] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:04:05.488620 29480 leader_election.cc:290] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:04:05.489750 22604 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
W20260808 20:04:05.489916 22607 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
I20260808 20:04:05.490033 22607 leader_election.cc:304] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:04:05.490278 29480 raft_consensus.cc:2749] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:04:07.429581 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 116: this message will repeat every 5th retry.
I20260808 20:04:07.462389 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:04:07.462684 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260808 20:04:07.522282 29569 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:04:07.522585 29569 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:04:07.524020 29569 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:04:07.524740 25934 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260808 20:04:07.528509 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:04:07.528975 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:04:07.529227 25931 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:04:07.529580 29569 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260808 20:04:07.862133 22607 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 111: this message will repeat every 5th retry.
I20260808 20:04:08.618660 29480 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:04:08.618871 29480 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:04:08.619666 29480 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:04:08.620946 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:04:08.621277 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:04:08.621434 22604 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:04:08.621723 29480 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:04:08.740494 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 116: this message will repeat every 5th retry.
W20260808 20:04:09.348043 22791 heartbeater.cc:646] Failed to heartbeat to 127.21.36.124:34593 (1294 consecutive failures): Network error: Failed to ping master at 127.21.36.124:34593: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:04:09.350278 23016 heartbeater.cc:646] Failed to heartbeat to 127.21.36.124:34593 (420 consecutive failures): Network error: Failed to ping master at 127.21.36.124:34593: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:04:09.539068 23254 heartbeater.cc:646] Failed to heartbeat to 127.21.36.124:34593 (638 consecutive failures): Network error: Failed to ping master at 127.21.36.124:34593: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:04:09.762555 22607 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 111: this message will repeat every 5th retry.
I20260808 20:04:10.142323 29480 raft_consensus.cc:493] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:04:10.142539 29480 raft_consensus.cc:515] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:04:10.143882 29480 leader_election.cc:290] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:04:10.144976 22607 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
W20260808 20:04:10.145146 22604 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
I20260808 20:04:10.145268 22604 leader_election.cc:304] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:04:10.145511 29480 raft_consensus.cc:2749] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:04:10.426707 22604 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 111: this message will repeat every 5th retry.
W20260808 20:04:10.659041 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 121: this message will repeat every 5th retry.
I20260808 20:04:11.398640 29480 raft_consensus.cc:493] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:04:11.398869 29480 raft_consensus.cc:515] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:04:11.399621 29480 leader_election.cc:290] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:04:11.400744 22607 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
W20260808 20:04:11.400918 22604 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
I20260808 20:04:11.401013 22604 leader_election.cc:304] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:04:11.401243 29480 raft_consensus.cc:2749] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:04:12.464926 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:04:12.465236 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:04:12.710613 22604 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 111: this message will repeat every 5th retry.
I20260808 20:04:13.245250 29657 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:04:13.245458 29657 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:04:13.246425 29657 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:04:13.247632 22607 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
W20260808 20:04:13.247784 22604 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:04:13.247907 22604 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:04:13.248250 29657 raft_consensus.cc:2749] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:04:14.122416 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 121: this message will repeat every 5th retry.
I20260808 20:04:14.406958 29715 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:04:14.407168 29715 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:04:14.407989 29715 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:04:14.412329 25934 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260808 20:04:14.413869 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:04:14.414034 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:04:14.414191 25931 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:04:14.414484 29715 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260808 20:04:15.675686 29703 raft_consensus.cc:493] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:04:15.675890 29703 raft_consensus.cc:515] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:04:15.676606 29703 leader_election.cc:290] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:04:15.678337 22604 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
W20260808 20:04:15.679288 22607 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
I20260808 20:04:15.679399 22607 leader_election.cc:304] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:04:15.679973 29480 raft_consensus.cc:2749] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:04:16.413672 29745 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:04:16.413872 29745 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:04:16.414861 29745 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:04:16.416059 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:04:16.416255 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:04:16.416356 22607 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:04:16.416584 29745 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:04:17.466897 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:04:17.467127 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:04:17.546604 22607 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 116: this message will repeat every 5th retry.
W20260808 20:04:17.752918 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 121: this message will repeat every 5th retry.
W20260808 20:04:18.926741 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 121: this message will repeat every 5th retry.
W20260808 20:04:19.992286 22607 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 116: this message will repeat every 5th retry.
I20260808 20:04:20.003659 29745 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:04:20.003830 29745 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:04:20.004508 29745 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:04:20.005414 22607 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
W20260808 20:04:20.005570 22604 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:04:20.005684 22604 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:04:20.005915 29745 raft_consensus.cc:2749] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:04:20.480525 22604 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 116: this message will repeat every 5th retry.
W20260808 20:04:20.794520 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 126: this message will repeat every 5th retry.
I20260808 20:04:22.469635 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:04:22.469874 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:04:22.895525 22604 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 116: this message will repeat every 5th retry.
W20260808 20:04:23.614315 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 126: this message will repeat every 5th retry.
I20260808 20:04:24.320941 29912 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:04:24.321182 29912 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:04:24.322012 29912 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:04:24.323347 25934 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260808 20:04:24.324929 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:04:24.325158 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
I20260808 20:04:24.325304 25934 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:04:24.325593 29912 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260808 20:04:24.351044 29875 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:04:24.351255 29875 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:04:24.351912 29875 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:04:24.352846 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:04:24.353039 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:04:24.353178 22607 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:04:24.353452 29875 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:04:27.206838 29876 raft_consensus.cc:493] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:04:27.207065 29876 raft_consensus.cc:515] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:04:27.208084 29876 leader_election.cc:290] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:04:27.209201 22604 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
W20260808 20:04:27.209386 22607 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
I20260808 20:04:27.209519 22607 leader_election.cc:304] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:04:27.209807 29876 raft_consensus.cc:2749] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:04:27.471782 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:04:27.472043 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:04:27.629027 22607 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 121: this message will repeat every 5th retry.
W20260808 20:04:27.815950 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 126: this message will repeat every 5th retry.
I20260808 20:04:28.531812 29969 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:04:28.532030 29969 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:04:28.532763 29969 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:04:28.533821 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:04:28.534032 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:04:28.534183 22604 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:04:28.534538 29969 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:04:29.440203 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 126: this message will repeat every 5th retry.
W20260808 20:04:29.587296 22607 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 121: this message will repeat every 5th retry.
W20260808 20:04:30.809909 22604 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 121: this message will repeat every 5th retry.
W20260808 20:04:31.268754 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 131: this message will repeat every 5th retry.
I20260808 20:04:31.851584 29975 raft_consensus.cc:493] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:04:31.851832 29975 raft_consensus.cc:515] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:04:31.852531 29975 leader_election.cc:290] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:04:31.853657 22604 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
W20260808 20:04:31.853827 22607 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
I20260808 20:04:31.853924 22607 leader_election.cc:304] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:04:31.854214 29975 raft_consensus.cc:2749] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:04:32.354277 29975 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:04:32.354497 29975 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:04:32.355259 29975 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:04:32.356345 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:04:32.356505 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:04:32.356643 22607 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:04:32.356891 29975 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:04:32.473883 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:04:32.474150 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:04:32.513816 22604 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 121: this message will repeat every 5th retry.
W20260808 20:04:33.028945 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 131: this message will repeat every 5th retry.
I20260808 20:04:34.899699 29975 raft_consensus.cc:493] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:04:34.899891 29975 raft_consensus.cc:515] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:04:34.900530 29975 leader_election.cc:290] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:04:34.901477 22604 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
W20260808 20:04:34.901623 22607 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
I20260808 20:04:34.901757 22607 leader_election.cc:304] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:04:34.901986 29975 raft_consensus.cc:2749] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:04:36.099716 29975 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:04:36.099923 29975 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:04:36.100762 29975 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:04:36.102010 22604 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
W20260808 20:04:36.102166 22607 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:04:36.102290 22607 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:04:36.102568 29975 raft_consensus.cc:2749] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:04:37.476617 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:04:37.476806 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:04:37.672920 22607 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 126: this message will repeat every 5th retry.
W20260808 20:04:37.797549 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 131: this message will repeat every 5th retry.
W20260808 20:04:38.836203 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 131: this message will repeat every 5th retry.
W20260808 20:04:39.824232 22607 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 126: this message will repeat every 5th retry.
I20260808 20:04:40.225508 30181 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:04:40.225688 30181 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:04:40.226506 30181 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:04:40.227499 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:04:40.227696 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:04:40.227833 22607 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:04:40.228102 30181 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:04:40.820969 22604 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 126: this message will repeat every 5th retry.
W20260808 20:04:41.299687 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 136: this message will repeat every 5th retry.
W20260808 20:04:42.060712 22604 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 126: this message will repeat every 5th retry.
I20260808 20:04:42.478448 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:04:42.478646 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:04:43.147162 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 136: this message will repeat every 5th retry.
I20260808 20:04:43.726898 30260 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:04:43.727224 30260 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:04:43.728173 30260 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:04:43.729190 25934 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260808 20:04:43.729190 25931 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:04:43.730588 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:04:43.730757 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:04:43.730855 25931 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:04:43.731052 30260 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260808 20:04:47.411751 22607 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 131: this message will repeat every 5th retry.
I20260808 20:04:47.480813 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:04:47.480993 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:04:48.143069 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 136: this message will repeat every 5th retry.
I20260808 20:04:48.212222 30315 raft_consensus.cc:493] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:04:48.212445 30315 raft_consensus.cc:515] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:04:48.213503 30315 leader_election.cc:290] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:04:48.214617 22604 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
W20260808 20:04:48.214793 22607 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
I20260808 20:04:48.214932 22607 leader_election.cc:304] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:04:48.215247 30315 raft_consensus.cc:2749] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:04:49.000877 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 136: this message will repeat every 5th retry.
W20260808 20:04:49.823340 22607 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 131: this message will repeat every 5th retry.
I20260808 20:04:50.085553 30371 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:04:50.085811 30371 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:04:50.086627 30371 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:04:50.087549 25934 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:04:50.088935 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:04:50.089098 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:04:50.089208 25931 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:04:50.089460 30371 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260808 20:04:50.833771 30384 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:04:50.833979 30384 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:04:50.834832 30384 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:04:50.836925 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
W20260808 20:04:50.837049 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
I20260808 20:04:50.837225 25931 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:04:50.837531 30384 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260808 20:04:51.332607 22604 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 131: this message will repeat every 5th retry.
I20260808 20:04:51.882776 30210 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:04:51.883031 30210 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:04:51.883752 30210 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:04:51.884827 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:04:51.885074 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:04:51.885190 22607 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:04:51.885469 30210 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:04:52.110920 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 141: this message will repeat every 5th retry.
W20260808 20:04:52.440411 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 141: this message will repeat every 5th retry.
I20260808 20:04:52.482714 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:04:52.482957 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:04:52.774371 22604 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 131: this message will repeat every 5th retry.
I20260808 20:04:54.444319 30314 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:04:54.444521 30314 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:04:54.445139 30314 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:04:54.446295 22607 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
W20260808 20:04:54.446463 22604 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:04:54.446619 22604 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:04:54.446897 30314 raft_consensus.cc:2749] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:04:54.615324 30314 raft_consensus.cc:493] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:04:54.615621 30314 raft_consensus.cc:515] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:04:54.616482 30314 leader_election.cc:290] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:04:54.617641 22604 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
W20260808 20:04:54.617812 22607 leader_election.cc:343] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 2523719318f84e31862e40d76f9a23f5
I20260808 20:04:54.617955 22607 leader_election.cc:304] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:04:54.618263 30314 raft_consensus.cc:2749] T 2523719318f84e31862e40d76f9a23f5 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:04:56.371151 22607 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 136: this message will repeat every 5th retry.
I20260808 20:04:57.484877 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:04:57.485105 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:04:58.272796 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 141: this message will repeat every 5th retry.
W20260808 20:04:58.896205 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 141: this message will repeat every 5th retry.
W20260808 20:05:00.100884 22607 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 136: this message will repeat every 5th retry.
I20260808 20:05:00.324154 30443 raft_consensus.cc:493] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:05:00.324407 30443 raft_consensus.cc:515] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:05:00.325580 30443 leader_election.cc:290] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:05:00.326978 22604 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
W20260808 20:05:00.327234 22607 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
I20260808 20:05:00.327447 22607 leader_election.cc:304] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:05:00.327868 30443 raft_consensus.cc:2749] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:05:01.545480 30580 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:05:01.545697 30580 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:05:01.546574 30580 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:05:01.547587 25934 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260808 20:05:01.548957 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:05:01.549165 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
I20260808 20:05:01.549284 25934 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:05:01.549549 30580 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260808 20:05:01.589902 22604 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 136: this message will repeat every 5th retry.
W20260808 20:05:02.153398 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 146: this message will repeat every 5th retry.
I20260808 20:05:02.486758 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:05:02.486994 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:05:02.646219 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 146: this message will repeat every 5th retry.
W20260808 20:05:03.086813 22604 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 136: this message will repeat every 5th retry.
W20260808 20:05:06.283272 22607 consensus_peers.cc:597] T 55cf64ca16df4afbae5f58843f613f27 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55cf64ca16df4afbae5f58843f613f27. This is attempt 141: this message will repeat every 5th retry.
I20260808 20:05:06.509651 30603 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:05:06.509858 30603 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:05:06.510842 30603 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:05:06.511997 22604 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
W20260808 20:05:06.512187 22607 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:05:06.512313 22607 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:05:06.512586 30603 raft_consensus.cc:2749] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:05:07.488636 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:05:07.488868 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:05:07.845194 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer 257c9c7e0c6c441593eac06beb31fa4e (127.21.36.65:39923): Couldn't send request to peer 257c9c7e0c6c441593eac06beb31fa4e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 146: this message will repeat every 5th retry.
W20260808 20:05:08.135726 23066 consensus_peers.cc:597] T 553ff75afb1d47d9b48410b8d6fa13dc P 5f6b6c2e318d44a984120a06a09e9af9 -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 553ff75afb1d47d9b48410b8d6fa13dc. This is attempt 146: this message will repeat every 5th retry.
W20260808 20:05:09.520702 23016 heartbeater.cc:646] Failed to heartbeat to 127.21.36.124:34593 (540 consecutive failures): Network error: Failed to ping master at 127.21.36.124:34593: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:05:09.551448 22791 heartbeater.cc:646] Failed to heartbeat to 127.21.36.124:34593 (1667 consecutive failures): Network error: Failed to ping master at 127.21.36.124:34593: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:05:09.551959 22607 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 141: this message will repeat every 5th retry.
W20260808 20:05:09.638391 23256 heartbeater.cc:646] Failed to heartbeat to 127.21.36.126:43945 (839 consecutive failures): Network error: Failed to ping master at 127.21.36.126:43945: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
I20260808 20:05:10.272429 30669 raft_consensus.cc:493] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34d5caee97d44fa945a91ddc6a54653)
I20260808 20:05:10.272629 30669 raft_consensus.cc:515] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } }
I20260808 20:05:10.273324 30669 leader_election.cc:290] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047), e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229)
W20260808 20:05:10.274451 22607 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
W20260808 20:05:10.274646 22604 leader_election.cc:343] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 96627957fadb4a0a8d9f69159d48cdf8
I20260808 20:05:10.292107 22604 leader_election.cc:304] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:05:10.292459 30669 raft_consensus.cc:2749] T 96627957fadb4a0a8d9f69159d48cdf8 P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260808 20:05:11.059916 22604 consensus_peers.cc:597] T c75913753d95447783b9b7c7bb6ee701 P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75913753d95447783b9b7c7bb6ee701. This is attempt 141: this message will repeat every 5th retry.
I20260808 20:05:11.542625 30669 raft_consensus.cc:493] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:05:11.542869 30669 raft_consensus.cc:515] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } } peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } }
I20260808 20:05:11.543727 30669 leader_election.cc:290] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:05:11.544884 22604 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
W20260808 20:05:11.545158 22607 leader_election.cc:343] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 0ef3105d34f447a592fd4de0d08f347f
I20260808 20:05:11.545285 22607 leader_election.cc:304] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:05:11.545542 30669 raft_consensus.cc:2749] T 0ef3105d34f447a592fd4de0d08f347f P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:05:12.018929 30780 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b91a1a84d6cd4038ac9d3ad2b8cf7979)
I20260808 20:05:12.019114 30780 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c4576401a74a60855647c956b195fd" member_type: VOTER last_known_addr { host: "127.21.36.126" port: 43945 } } peers { permanent_uuid: "16a59d796024414abf9f82a7593530a6" member_type: VOTER last_known_addr { host: "127.21.36.125" port: 36441 } } peers { permanent_uuid: "b91a1a84d6cd4038ac9d3ad2b8cf7979" member_type: VOTER last_known_addr { host: "127.21.36.124" port: 34593 } }
I20260808 20:05:12.019884 30780 leader_election.cc:290] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d2c4576401a74a60855647c956b195fd (127.21.36.126:43945), b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593)
W20260808 20:05:12.020990 25934 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260808 20:05:12.022163 25931 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b91a1a84d6cd4038ac9d3ad2b8cf7979 (127.21.36.124:34593): Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:05:12.022336 25934 leader_election.cc:336] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d2c4576401a74a60855647c956b195fd (127.21.36.126:43945): Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111)
I20260808 20:05:12.022454 25934 leader_election.cc:304] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16a59d796024414abf9f82a7593530a6; no voters: b91a1a84d6cd4038ac9d3ad2b8cf7979, d2c4576401a74a60855647c956b195fd
I20260808 20:05:12.022716 30780 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 16a59d796024414abf9f82a7593530a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260808 20:05:12.065232 22604 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Couldn't send request to peer e34d5caee97d44fa945a91ddc6a54653. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 151: this message will repeat every 5th retry.
I20260808 20:05:12.117404 30603 raft_consensus.cc:493] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f6b6c2e318d44a984120a06a09e9af9)
I20260808 20:05:12.117617 30603 raft_consensus.cc:515] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e34d5caee97d44fa945a91ddc6a54653" member_type: VOTER last_known_addr { host: "127.21.36.66" port: 46229 } } peers { permanent_uuid: "5f6b6c2e318d44a984120a06a09e9af9" member_type: VOTER last_known_addr { host: "127.21.36.67" port: 43047 } } peers { permanent_uuid: "257c9c7e0c6c441593eac06beb31fa4e" member_type: VOTER last_known_addr { host: "127.21.36.65" port: 39923 } }
I20260808 20:05:12.118391 30603 leader_election.cc:290] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229), 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047)
W20260808 20:05:12.119527 22604 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e34d5caee97d44fa945a91ddc6a54653 (127.21.36.66:46229): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
W20260808 20:05:12.119696 22607 leader_election.cc:343] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Not found: Tablet not found: 27b71167912a4250a58941600e22488e
I20260808 20:05:12.119796 22607 leader_election.cc:304] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 257c9c7e0c6c441593eac06beb31fa4e; no voters: 5f6b6c2e318d44a984120a06a09e9af9, e34d5caee97d44fa945a91ddc6a54653
I20260808 20:05:12.120077 30603 raft_consensus.cc:2749] T 27b71167912a4250a58941600e22488e P 257c9c7e0c6c441593eac06beb31fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 20:05:12.490748 25908 master_runner.cc:187] Error getting master registration for 127.21.36.126:43945: Network error: Client connection negotiation failed: client connection to 127.21.36.126:43945: connect: Connection refused (error 111),
I20260808 20:05:12.490993 25908 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260808 20:05:12.503315 22607 consensus_peers.cc:597] T 7117a3852b424a2d83a00b4ebab727cf P 257c9c7e0c6c441593eac06beb31fa4e -> Peer 5f6b6c2e318d44a984120a06a09e9af9 (127.21.36.67:43047): Couldn't send request to peer 5f6b6c2e318d44a984120a06a09e9af9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7117a3852b424a2d83a00b4ebab727cf. This is attempt 151: this message will repeat every 5th retry.
W20260808 20:05:12.830884 23273 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:05:12.831207 23273 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:05:12.831326 23273 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
W20260808 20:05:12.831533 23273 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
F20260808 20:05:12.842461 23313 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
*** Check failure stack trace: ***
*** Aborted at 1786219512 (unix time) try "date -d @1786219512" if you are using GNU date ***
F20260808 20:05:12.844398 23312 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260808 20:05:12.844398 23312 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.844724 23300 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5730907850e643b4ac068a85e1574ddf on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260808 20:05:12.844398 23312 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.844724 23300 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5730907850e643b4ac068a85e1574ddf on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.845043 23303 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_aa0809b208774982934a9f8de43aecf5 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
*** Check failure stack trace: ***
W20260808 20:05:12.845672 23274 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.21.36.124:34593)
W20260808 20:05:12.846024 23274 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.21.36.124:34593)
F20260808 20:05:12.844398 23312 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.844724 23300 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5730907850e643b4ac068a85e1574ddf on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.845043 23303 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_aa0809b208774982934a9f8de43aecf5 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.846305 23298 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f5c38573b0784ce8816d5a8a04f841d8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260808 20:05:12.844398 23312 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.844724 23300 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5730907850e643b4ac068a85e1574ddf on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.845043 23303 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_aa0809b208774982934a9f8de43aecf5 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.846305 23298 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f5c38573b0784ce8816d5a8a04f841d8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.846321 23315 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260808 20:05:12.844398 23312 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.844724 23300 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5730907850e643b4ac068a85e1574ddf on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.845043 23303 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_aa0809b208774982934a9f8de43aecf5 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.846305 23298 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f5c38573b0784ce8816d5a8a04f841d8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.846321 23315 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.847618 23323 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260808 20:05:12.844398 23312 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.844724 23300 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5730907850e643b4ac068a85e1574ddf on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.845043 23303 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_aa0809b208774982934a9f8de43aecf5 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.846305 23298 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f5c38573b0784ce8816d5a8a04f841d8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.846321 23315 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.847618 23323 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.847719 23293 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bfc21652528345b883ecf7962d128fee on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260808 20:05:12.844398 23312 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.844724 23300 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5730907850e643b4ac068a85e1574ddf on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.845043 23303 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_aa0809b208774982934a9f8de43aecf5 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.846305 23298 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f5c38573b0784ce8816d5a8a04f841d8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.846321 23315 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.847618 23323 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.847719 23293 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bfc21652528345b883ecf7962d128fee on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.848001 23308 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260808 20:05:12.844398 23312 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.844724 23300 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5730907850e643b4ac068a85e1574ddf on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.845043 23303 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_aa0809b208774982934a9f8de43aecf5 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.846305 23298 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f5c38573b0784ce8816d5a8a04f841d8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.846321 23315 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.847618 23323 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.847719 23293 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bfc21652528345b883ecf7962d128fee on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.848001 23308 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.848301 23316 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260808 20:05:12.844398 23312 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.844724 23300 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5730907850e643b4ac068a85e1574ddf on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.845043 23303 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_aa0809b208774982934a9f8de43aecf5 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.846305 23298 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f5c38573b0784ce8816d5a8a04f841d8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.846321 23315 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.847618 23323 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.847719 23293 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bfc21652528345b883ecf7962d128fee on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.848001 23308 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.848301 23316 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.849534 23310 master-stress-test.cc:353] Check failed: _s.ok() Bad status: F2026Ti08d out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111) 20:05:12.849545 23318 master-stress-test.cc:353] Check failed: _s.ok() Bad status:
*** Check failure stack trace: ***
F20260808 20:05:12.844398 23312 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.844724 23300 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5730907850e643b4ac068a85e1574ddf on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.845043 23303 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_aa0809b208774982934a9f8de43aecf5 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.846305 23298 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f5c38573b0784ce8816d5a8a04f841d8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.846321 23315 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.847618 23323 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.847719 23293 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bfc21652528345b883ecf7962d128fee on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.848001 23308 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.848301 23316 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.849534 23310 master-stress-test.cc:353] Check failed: _s.ok() Bad status: F2026Ti08d out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111) 20:05:12.849545 23318 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260808 20:05:12.844398 23312 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.844724 23300 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5730907850e643b4ac068a85e1574ddf on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.845043 23303 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_aa0809b208774982934a9f8de43aecf5 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.846305 23298 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f5c38573b0784ce8816d5a8a04f841d8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.846321 23315 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.847618 23323 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.847719 23293 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bfc21652528345b883ecf7962d128fee on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.848001 23308 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.848301 23316 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.849534 23310 master-stress-test.cc:353] Check failed: _s.ok() Bad status: F2026Ti08d out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111) 20:05:12.849545 23318 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.850817 23309 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260808 20:05:12.844398 23312 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.844724 23300 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5730907850e643b4ac068a85e1574ddf on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.845043 23303 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_aa0809b208774982934a9f8de43aecf5 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.846305 23298 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f5c38573b0784ce8816d5a8a04f841d8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.846321 23315 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.847618 23323 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.847719 23293 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bfc21652528345b883ecf7962d128fee on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.848001 23308 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.848301 23316 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.849534 23310 master-stress-test.cc:353] Check failed: _s.ok() Bad status: F2026Ti08d out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111) 20:05:12.849545 23318 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.850817 23309 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)F20260808 20:05:12.850835 23306 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.21.36.126:43945,127.21.36.125:36441,127.21.36.124:34593, num_attempts: 736) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.21.36.124:34593: connect: Connection refused (error 111)
*** Check failure stack trace: ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800005491) received by PID 21649 (TID 0x7fbdaa34c700) from PID 21649; stack trace: ***
@ 0x7fbdc4748980 (unknown) at ??:0
@ 0x7fbdbd514e87 gsignal at ??:0
@ 0x7fbdbd5167f1 abort at ??:0
@ 0x7fbdc025cd5d google::LogMessage::Fail() at ??:0
@ 0x7fbdc0260b23 google::LogMessage::SendToLog() at ??:0
@ 0x7fbdc025c75c google::LogMessage::Flush() at ??:0
@ 0x7fbdc025dee9 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x40a62c kudu::MasterStressTest::DeleteTableThread() at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/master-stress-test.cc:353
@ 0x4472f4 std::__invoke_impl<>() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/invoke.h:73
@ 0x4471ad std::__invoke<>() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/invoke.h:95
@ 0x44716a _ZNSt6thread8_InvokerISt5tupleIJMN4kudu16MasterStressTestEFvvEPNS2_26MasterStressTest_Test_TestEEEE9_M_invokeIJLm0ELm1EEEEDTclsr3stdE8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:234
@ 0x44711e std::thread::_Invoker<>::operator()() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:243
@ 0x446e59 std::thread::_State_impl<>::_M_run() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:186
@ 0x7fbdbdb9e6df (unknown) at ??:0
@ 0x7fbdc473d6db start_thread at ??:0
@ 0x7fbdbd5f761f clone at ??:0